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Abstract. We define the odd symplectic grassmannians and flag manifolds, 
which are smooth projective varieties equipped with an action of the odd sym- 
plectic group and generalizing the usual symplectic grassmannians and flag 
manifolds. Contrary to the latter, which are the flag manifolds of the sym- 
plectic group, the varieties we introduce are not homogeneous. We argue 
J^ , nevertheless that in many respects the odd symplectic grassmannians and flag 

*""P' manifolds behave like homogeneous varieties; in support of this claim, we com- 

pute the automorphism group of the odd symplectic grassmannians, and we 
prove a Borel-Weil type theorem for the odd symplectic group. 



1. Introduction 



In Pro88 Proctor introduces the odd symplectic group, a generalization of the 
symplectic group on an odd dimensional space defined as the group of linear trans- 
formations preserving a generic skew-form. His initial motivation is a series of 
combinatorial identities, but Proctor goes on to study a certain class of represen- 
tations of this group (which is not reductive) and eventually proves a character 
formula very similar to Weyl's formula for the simple Lie groups. In this way the 
odd symplectic group presents some similarities with the simple Lie groups and 
appears to fit nicely in the framework of the classical groups, filling the "gap" in 

(SI '. thc scries i S P2n}™- 

£f) • Here, we take a different look at this situation, from a more geometric perspec- 

tive. Recall that the flag manifolds of the symplectic group, Sp 2 „/P, with P a 
parabolic subgroup in Sp 2n , identify with the varieties of flags of isotropic sub- 
spaces of C 2 ". We generalize these varieties to the odd symplectic situation, in 
the most straightforward way : let w be a generic skew-form on C 2n+1 and define 

£ the odd symplectic flag manifolds to be the varieties of flags of subspaces of C 2n+1 

isotropic with respect to w. These are projective varieties and are equipped with 
natural actions of the odd symplectic group Sp 2n+1 which preserves the skew- form 
lj. Unlike in the symplectic setting however, these actions are no longer transitive, 
as the non trivial kernel of the skew-form is preserved by Sp 2n+1 and therefore 
isotropic flags having different incidence relations with this kernel cannot be in the 



same orbit. 
03 



The aim of this paper is to present some evidence that the odd symplectic flag 
manifolds, although not homogeneous, fill the role of flag manifolds for the odd 
symplectic group. Part of this evidence, for example, is constituted by the theo- 
rems below describing respectively the automorphism group of the odd symplectic 
grassmannians and a Borel-Weil theorem for the odd symplectic group, which show 
that sometimes the symplectic flag manifolds and their odd symplectic counterparts 
behave like a "series" . 

The reason we do not simply consider the homogeneous spaces Sp 2n+1 /P, for 
P C Sp 2n+1 a parabolic subgroup, as "flag manifolds" for Sp 2 „ +1 , is that, as it 
will become clear below, these coincide with the flag manifolds of the symplectic 
group Sp 2 „, and therefore do not constitute representative examples for the odd 
symplectic situation. 

l 
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The odd symplectic flag manifolds are not homogeneous but it turns out they 
are quasi-homogeneous. The odd symplectic group acts with finitely many orbits, 
described by the incidence relations with the kernel mentioned above. They are 
also smooth, which follows from the fact that, as subvarieties of the (type A) flag 
manifolds defined by forgetting the isotropy conditions, they appear as the zero 
locus of a generic section of a vector bundle. 

A natural question is whether the odd symplectic flag manifolds admit a cellular 
decomposition similar to the decomposition into Schubert cells of the usual symplec- 
tic flag manifolds. In the symplectic case, and in general for all the flag manifolds 
of the classical groups, the Schubert cells can be defined in several equivalent ways, 
eg they can be described by incidence relations with respect to a fixed flag and they 
coincide with the orbits of a Borel subgroup. It turns out that these two recipes 
can be used in the odd symplectic setting as well to define cell decompositions of 
the odd symplectic flag manifolds. 

Actually, the odd symplectic flag manifolds themselves can be identified with 
certain Schubert subvarieties in symplectic flag manifolds (and then the cell de- 
compositions above coincide with their cell decomposition as Schubert varieties). 
This goes as follows: the generic skew-form u> on C 2n+1 can be extended to a sym- 
plectic form us on C 2n+2 , so that any odd symplectic flag manifold associated to 
uj is identified with the Schubert subvariety of the corresponding symplectic flag 
manifold associated to u> given by those flags which are contained in the hyperplane 
C 2n+1 . The parabolic subgroup of Sp 2n+2 which preserves the hyperplane C 2n+1 
acts therefore on the odd symplectic flag manifolds, via the morphism of restriction 
to C 2rl+1 which is surjective with image Sp 2T j +1 . 

The subgroup Sp 2n+1 of this parabolic subgroup which fixes an equation of the 
hyperplane C 2n+1 (or, equivalently, a vector e generating the kernel of ui) has been 



considered before by Gelfand and Zelevinski in GZ84 as a variant odd symplectic 
group, in connection to the problem of constructing representation models for the 
classical groups. We will call it the intermediate odd symplectic group to distinguish 
it from the odd symplectic group considered above. This group has been considered 



later by Shtepin in |Sht9 3> where he constructs a series of Sp 2n+1 -modules as a 
means to separate multiple components when restricting simple Sp 2n+2 -modules 
to Sp 2rl . Its Lie algebra sp 2n+1 coincides with the intermediate Lie algebra of the 
symplectic Lie algebra sp 2n+2 , a general construction which can be associated to 
any simple Lie algebra (which is used for example in LM06 to construct the Lie 
algebra e 7 i sitting between the exceptional Lie algebras e 7 and t%). 

In this paper we will focus only on the extremal types of odd symplectic flag 
manifolds, namely the odd symplectic grassmannians 

G u (k,2n + 1) = {V | V c C 2n+1 ,dimV" = k, V isotropic/ w} 

and the variety of maximal flags of isotropic subspaces F w (2n + 1), which we simply 
call the odd symplectic flag manifold. Since the maximal isotropic subspaces in 
C 2n+1 are those of dimension n+1, the variety F w (2n + 1) is the variety of flags of 
the form V, = (Vj. C V2 C • • • C V n +i) with each Vt C C 2n+1 isotropic of dimension 
i. These varieties are the analogues in the odd symplectic setting of the symplectic 
grassmannians G UJ {k,2n) and the odd symplectic flag manifold F w (2n), which are, 
respectively, the minimal and the maximal flag varieties of the symplectic group 

Sp 2 „- 

We compute the automorphism group of the odd symplectic grassmannians 
G w (/c,2n + 1) and find out that for 2 ^ k ^ n it equals PSp 2n+1 , the quotient 
of Sp 2r!+1 by its center {±1} (for k = n + 1 the odd symplectic grassmannian 
G u (n + l,2n + 1) is isomorphic to the symplectic grassmannian G w (n, 2n) and 
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therefore its automorphism group is PSp 2 „). In this respect the odd symplectic 
grassmannians behave like homogeneous flag manifolds, since, as a general rule, the 
connected automorphism group Aut° (G/P) of a flag manifold is the adjoint group 
PG (there are some exceptions to this rule, sec Akh95, §3.3, Theorem 2]) . This is 
also suggestive of the behavior of the symplectic and odd symplectic grassmannians 
as a series, as we can state this result in the following uniform manner: 

Theorem. For integers N and k such that 2 ^ k ^ [-^V/2] , the automorphism group 
of the variety G ul (k, N) is PSp^ — Sp N /{±l}. 

Finally, this also shows a close connection between the group Sp 2rl+1 and the 
odd symplectic grassmannians G UJ {k, In + 1) since, up to the center {±1}, we can 
recover Sp 2n+1 from the geometry of G UJ (k, 2n + 1) (which is not the case for the 
homogeneous spaces Sp 2n+1 /-P, P a parabolic subgroup of Sp 2n+1 ). 

Another natural question is whether there is an analog of the Borel-Weil the- 
orem for the odd symplectic group. The usual Borel-Weil theorem connects the 
representation theory of a simple complex Lie group G with the geometry of the 
flag variety G/B by explicitly identifying the simple G-modules with the spaces of 
global sections of the line bundles on G/B. There are two points that need to be 
addressed in order to generalize this to the odd symplectic setting. First, the odd 
symplectic group is not reductive and therefore the simple modules do not play 
the same role in its representation theory as they do in the symplectic case. We 
need to replace them by another class of preferred representations, and it is natural 
to consider the class of Sp 2n+1 -modules introduced by Proctor. These are defined 
by porting to the odd symplectic setting the construction of Weyl of the simple 
modules of the symplectic group. Specifically, for A a partition with at most n + 1 
parts define the Sp 2n+1 -module S(\)C 2n+1 as the intersection of the Schur power 
S\C 2n+1 with the kernels of all the possible contractions with the odd symplectic 
form u) (the "trace free" part of S\C 2n+1 ). We may also consider the representa- 
tions of the intermediate odd symplectic group Sp 2n+1 which were introduced by 
Shtcpin. We show that actually these are isomorphic to the representations defined 
by Proctor, via the natural morphism Sp 2n+1 — > Sp 2n+1 . The second point that 
needs attention is that the odd symplectic flag manifold ¥ LJ (2n + 1) is not homoge- 
neous, so we no longer have a correspondence between line bundles and characters 
as in the symplectic case. It is natural then to use the fact that ¥ UJ (2n + l) identifies 
with a Schubert subvariety in the symplectic flag manifold ¥ UJ (2n + 2) and consider 
those line bundles on ¥ UJ (2n + 1) which come from ¥ ul (2n + 2). We write them in 
terms of the tautological bundles, and eventually obtain: 

Theorem. For N an integer let n = [(N - l)/2]. Let A = (A Js Ai > • • • ^ A„) 

be a partition with at most n + 1 parts. Denote by L\ the line bundle on F W (C ) 
given by 

L x = T*® A ° ® (T 2 /Ti)*® Al g) • • • ® (T„ +1 /T n )*® A " 

where Ti is the rank i tautological vector bundle on ¥ UJ (C N ). Then, as Sp N -modules, 
we have 

H°(¥ u (C N ),L x )~(S {x) C N y. 

Here, when N = 2n + 2 we get the usual Borel-Weil theorem for the symplectic 
group Sp 2rl+2 . So again we notice the behavior of the symplectic and odd symplectic 
flag manifolds as a series. 



In a forthcoming paper ( |Mih| ) we study the equivariant cohomology of the odd 
symplectic flag manifold ¥ u (2n + 1) correspondig to the action of a maximal torus 
of Sp 2rl+1 . In particular, we compute the singular cohomology algebra H*(¥ UJ (2n + 
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1), C) which turns out to be isomorphic to the singular cohomology algebra of the 
flag manifold G/B for G of type D„ + i. 

Overview. This paper is organized as follows. In the second section we gather 
some basic facts and fix notation concerning the symplectic groups and their flag 
manifolds. In the third section we introduce Proctor's odd symplectic group and list 
some of its properties. We also recall here the intermediate odd symplectic group of 
Gelfand and Zelevinski and its relation with the odd symplectic group. In the fourth 
section we define the odd symplectic flag manifolds. We describe the Sp 2 „ +1 -orbits 
and the Schubert decompositions in the case of the odd symplectic grassmannians 
and the odd symplectic flag manifold. The fifth section deals with the computation 
of the automorphism group of the odd symplectic grassmannians. We conclude, in 
the sixth section, with the Borcl-Wcil theorem for the odd symplectic group. 

Acknowledgements. I warmly thank Laurent Manivel for his invaluable help and 
support in writing this article. I also thank Patrick Polo for his very useful com- 
ments concerning section 6. This paper has been written while I was a post-doc 
fellow at the Weizmann Institute of Science under the Marie Curie RTN Liegrits. 
I wish to thank my hosts for their hospitality and the perfect working conditions 
they provided. 



Contents 



rrrh^a^cMonl 1 



F^relhTrmjui^y 4 



^Tdic^cki^^TrrrjlecMc^r^vrrjL $ 



Odd symplectic flag manifolds! 11 



^T^c^^^m^Dhi^r^^u^^^^n^dc^s^nrrjk^cMc^^ssjnamrijajj 18 

_A_FJorcl-Weil theorem for the odd symplectic group! 27 






References! 31 



2. Preliminaries 

We start by reviewing some basic facts about the symplectic group and its flag 
manifolds. 

2.1. Let F complex vector space of dimension 2n and u) £ h?F* a symplectic form 
on F, ie a skew-symmetric, non-degenerate form. A subspace V C F is isotropic if 
ui(x,y) = for all x, y £ V. A symplectic basis is a basis {ei, . . . ,e2 n } of F such 
that 

u>(ei,ej) = Sijn+i-j 

for all 1 ^ i,j ^ In. Any symplectic form admits a symplectic basis. A standard 
notation convention, which we will also use in this paper, is to denote i = In + 1 — i 
for i £ {1, . . . , 2n}. A symplectic basis is therefore a basis {ei, . . . , e n , e„, . . . , ej} 
such that w(ej,ej) = 8^ for all 1 ^ i,j ^ In. In a symplectic basis, the matrix of 
the form u> is 

' A" 



J ~ ' -A 

where A is the n x n matrix whose anti-diagonal entries are all equal to 1 and all 
the other entries are 0. 
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2.2. The symplectic group Sp 2 „ is the stabilizer of u> in GL(_F) for the standard 
action of GL(F) in A 2 F* . It is a simple algebraic group. The choice of a symplectic 
basis identifies Sp 2n with the matrix group 

{ 5 GGL(2n,C)| t gJg= J}. 

From now on, we fix a symplectic basis {ei, . . . , e 2 „} and identify Sp 2 „ with this 
matrix group. 

The subgroup of Sp 2 „ of upper triangular matrices in the basis {ei, . . . , e 2 „} is 
a Borcl subgroup. Also, the subgroup T 2n of Sp 2n of diagonal matrices in the basis 
{ei, . . . , e 2n } is a maximal torus. We have 

T 2n = {diag(ii, ...,t n , t-\ ..., t, 1 ) | ti, . . . , t n e C*}, 

where diag(xi, . . . ,x 2n ) denotes the diagonal matrix whose diagonal entries are 
Xi, ■ ■ ■ , x 2n . Denote by £1, . . . , £i n the characters £j : diag(xi, . . . , x 2n ) i— ► Xi of 
T 2n . Then 

£t = -£i 
for all 1 ^ i ^ n and the characters £±, . . . , e n form a basis of the character group 
ofT 2n . 

2.3. The Lie algebra of the symplectic group identifies with the subalgebra of gl 2n 

SP 2 „ = {X E l 2n | t XJ+JX = 0}. 
We have X — (xij) £ sp 2n if and only if 

Xij — Xji^ ^ij — Xji, Xij — Xj^ 

for all 1 ^ i,j ; ^ n. Let Eij by the elementary matrix with a 1 in the i row and j 
column, and denote 

X^ = E^ — Ep for 1 ^ i, j ^ n and 

Xij = E^ + Eji, Xij = E^ + Eji, for 1 ^ i ^ j ^ n. 

These elements make a basis of sp 2n - 

The elements Xa, 1 ^ i ^ n, form a basis of the Cartan subalgebra t 2n of 
diagonal matrices in sp 2 „. The elements Xij,Xij, 1 ^ i ^ j ^ n, form a basis of 
the Borel subalgebra b 2n of sp 2n °f upper triangular matrices. The roots of sp 2n 
are 

±(£j -£j), 1 s^ i < j < n 

±(si + £,), 1 ^ i < j < n 

and for 1 ^ k ^ £ $C 2n, the root space of sp 2n corresponding to the root Ek — £i 
is CXke- In particular, the roots of the Borel subalgebra b 2 „, which we choose as 
positive roots, are £j — Sj, 1 ^ % < j ^ n, and £j + £j, 1 ^ « ^ j ^ n. 

2.4. The Weyl group V^(Sp 2 „) = N S p 2n (T 2n )/T 2n of the symplectic group Sp 2 „ is 
isomorphic to the group of linear transformations of F which permute the vectors 
ei of the symplectic basis and commute with the matrix J. It identifies with the 
group of permutations of the set {1, . . . , 2n} which commute with the involution 

i i— > i 



(1) V^(S P2 „) = {we S 2n | w(j) = w(i)}, 

the correspondence being given by 

w.ei = e w (i), 1 ^ i < 2n, tu e W(Sp 2n ). 

Then the action of Vy(Sp 2 „) on the character group of the maximal torus is given 
by the rule 

w.Si = e w(i) , H K «, we V^(Sp 2n ). 
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Any element w G W(Sp 2n ) * s determined by its values on the set {1, . . . , n}. To 
represent w we use the one-line notation w(l)w(2) . . . w(n) with the convention to 
write i instead of j = I when j ^ n + 1. For example, for n = 4, 1674 gets written 
1324. Given that e^ = —e%, the bars in the one-line notation correspond to sign 
changes in the action on the characters, and VF(Sp 2n ) identifies in this way to the 
signed permutations of the s\, . . . , e n . 

The group W(Sp 2n ) i s a Coxeter group generated by the reflections correspond- 
ing to the simple roots. The length £(w) of an clement w is the minimal number 
of simple reflections required to express w as a product of reflections. The longest 
element of W(Sp 2n ) ^ s 12 ... n and its length is n 2 . 

The Bruhat order on the Weyl group VF(Sp 2n ) is defined by w ^ w' if and only 
if there is a chain 

w — Wi — » u>2 — * ■ • ■ — * Wd = w 
such that, for all 1 ^ i ^ d — 1, t(wi+i) = £(v)i) + 1 and Wj+i = (7 Q Wi for a root a. 

2.5. Symplectic flag manifolds. For 1 ^ d\ < d 2 < ■ ■ ■ < d r ^ n a sequence 
of integers, denote by ¥ UJ (di, . . . , d r , F) the projective variety of flags of isotropic 
subspaces 

{(V dl C • • • C Vd r C F) | dimVd s = dj, V d% isotropic for all 1 ^ i ^ r}. 

The symplectic group acts naturally on this variety and the action is transitive, ie 
this variety is a homogeneous space Sp 2 „/P with P a parabolic subgroup. Con- 
versely, any homogeneous space Sp 2n /P with P a parabolic subgroup is isomorphic 
to one of the varieties F w (di, . . . , d r , F). We call them symplectic flag manifolds. 

When r = 1 we will write G UJ (k, F) instead of ¥ LU (k,F) and call the varieties 
G u (k, F) symplectic grassmannians. These are subvarieties of the usual grassman- 
nians G(fc, F) and are isomorphic to the homogeneous spaces Sp 2n /P with P a 
maximal parabolic subgroup. When r = n we denote F U (F) =¥ lv (l,...,n,F) and, 
if there is no risk of confusion, simply call F w (F) the symplectic flag manifold. This 
is isomorphic to the homogeneous space Sp 2n /-E> with B a Borel subgroup. Since 
the isomorphism class of these varieties depends only on the dimension of F, we 
will also write G u (k, 2n) and F aJ (2n) instead of G u ,(k, F) and, respectively, ¥ UJ (F). 

2.6. Schubert cells in symplectic grassmannians. Let's fix in F the flag 
E, = (Ei C E 2 C ■ ■ ■ C E 2n ) generated by the symplectic basis {ei, . . . ,e 2 „} ie 
such that Ei = (ei, . . . , e^} for all 1 $J i ^ In (we also say that {ei, . . . , e 2n } is an 
adapted basis for the flag E,). 

2.7. The incidence of a /c-dimensional subspace V C F with the flag E, is given 
by the integers ri = dim(V n Ei). Let i\ < i 2 < ■ ■ ■ < if. be the positions of the k 
jumps in the sequence 

= r sC n s^ • • • s^ r 2 „_i < r 2n = k, 

that is 

i a = min{z | 1 ^ i ^ 2n, r^ = a}, for 1 $J a ^ k. 

We say that the multi-index I = (1 ^J i\ < i 2 < • • • < i\. ^ In) is the incidence type 
of V with the flag E, . 

Not all indices appear as incidence types of isotropic subspaces. We call those 
who do admissible. These are precisely those / = (1 ^J i\ < • • • < i^ ^ In) for 
which i a =/= ip for all 1 ^ a, (3 ^ k, that is, for each 1 ^ i ^ n, at most one of i or i 
appears in /. 

Notation 2.8. We denote lk,2n the set of multi-indices (1 ^ i\ < i 2 < ■ ■ ■ < i\. ^ 

2n) and T£ 2n the subset of Ifc,2n of admissible indices. 
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The Schubert cell in the symplectic grassmannian G UJ (k,2n) associated (with 
respect to the flag E,) to an admissible multi- index I G I£ 2n is the set of isotropic 
subspaccs of dimension k whose incidence type is /, ie 

Ci = {V G G w (fc,2n) | dim(V (lEi) — a, i a < i < i a+1 , 1 < a ^ fc}, 

where we put ik+i = 2n + 1. If B2 n denotes the Borel subgroup of Sp 2 „ which 
fixes the flag E,, then the Schubert cells, which are clearly i?2n-stable, are actually 
^2n-orbits. The symplectic grassmannian G w (fc, F) decomposes as a disjoint union 

G u {k,F)= |J d. 

2.9. The Schubert cell Cj is the set of isotropic subspaces of dimension k which, 
with respect to the symplectic basis {ei, . . . , e2 n }, can be generated by the rows of 
a row-echelon matrix of type /, that is a k x In matrix (a a i) for which each entry 
a a i a is non zero and all the entries to its right are zero. Each V G Cj is generated 
by the rows of a unique such matrix if we require additionally that the entries a a i a 
be 1 and the entries below an entry a a i a be zero. The remaining entries are free 
entries except for those below an entry opposed to a 1 (ie below an entry a a — ) 
which are determined. The free entries define an isomorphism between Gi and the 
affinc space A dim Cl . 

For example, in the symplectic grassmannian G w (3, 8) the Schubert cell defined 
by the multi-index (4, 6, 8) = (4, 3, 1) is given by the row-space of the matrix 

'* * * 1 N 

***0»100 

^* * • • * \ / 

We have marked by * the free entries and by • those which are determined. 

2.10. On the set I/c,2n we consider the order relation for which / $J J if and only if 
j tt ^ j a for all 1 ^ a $C k. We consider the induced order on the subset I£ 2n C Ifc,2n 
of admissible indices. 

Let Pfc be the parabolic subgroup of Sp 2 „ which stabilizes the subspace E^ = 
(ei, . . . , efe), so that G u ,(k, F) = Sp 2n /Pk- Then Pfc is the maximal parabolic sub- 
group which misses the simple root ak — £k — £fc+i- The Weyl group W(Pk) of Pk 
is isomorphic to Su x W(Sp 2 ( n -k))- The coset space W(Sp 2n )/W(Pk) is in bijec- 
tion with the T2„-fixed points in Sp 2n /Pk, and therefore with 1^ 2n . Explicitly, this 
bijection associates to the class of w G W(Sp 2n ) the multi-index {w(l), . . . , w(fc)}| 
obtained by arranging in increasing order the elements of the set {w(l), . . . , w(k)}. 
Via this bijection, the order on I£ 2n corresponds with the order on W(Sp 2n )/W(Pk) 
inherited from the Bruhat order on T4 7 (Sp 2 „), and so with the Bruhat order on the 
set of Schubert cells. That is, for all /, J G 1% 2n , 

Ci C C] ^=^ I^J- 

2.11. The Schubert subvarieties of the symplectic grassmannian G ul (k,F) are the 
closures of the Schubert cells. Since the Bruhat order of the Schubert cells agrees 
with the order on I£ 2 n> ^ ne Schubert subvariety Xj = Ci is given by 



Xi=\J Cj. 



j<i 



Therefore, in terms of the incidence with the flag E mi the Schubert subvariety Xj 
is characterized by 

X I = {V eG u {k,F) | dim(VnE la ) > a, 1 < a ^ k}. 
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2.12. Schubert cells in the symplectic flag manifold. For a signed per- 
mutation w 6 W(Sp 2n ) the rank function r w is the function which to a pair 
(i,j) € {1, . . . ,n} X {1, . . . , 2n} associates the number 

r w{i,j) = cardjfc | k ^ i,w{k) ^ j}. 

The integer r w (i,j) is therefore the number of points in the graph {(fc, w(k)) | 1 ^ 
k ^ n} of w, situated in the rectangle {1, . . .,i} X {1, . . . , j}. 

The Schubert cell C w of the symplectic flag manifold ¥ U1 (F) associated (with 
respect to the flag E m ) to a signed permutation w £ W(Sp 2n ) is the set of flags of 
isotropic subspaces V, = (Vi C ■ ■ ■ C V n ) which verify 

dinuTi n Ej) =r w (i,j) 

for all 1 ^ i ^ n and all 1 ^ j ^ 2n. The Schubert cells coincide with the orbits of 
the Borel subgroup B 2n of Sp 2n which fixes the flag E, . Note that we have V, G C w 
if and only if Vi G C'{ lu ( 1 ) i ... tW u)}i for all 1 ^ i ^ n. 

2.13. The Schubert cell C w is the set of flags of isotropic subspaces which, with 
respect to the symplectic basis {ei, . . . ,e 2n }, admit as adapted basis the rows of 
a n x In matrix (a^) for which a iw <^ — 1 and a^ = for all 1 ^J i ^ n and 
1 ^ j ^ 2n, j > w(i). Note that the entries which are preassigned the value 1 
correspond to the points of the graph of w. 

2.14. The Bruhat order on W(Sp 2n ) agrees with the Bruhat order on the set of 
Schubert cells, that is, for all w,w' £ W(Sp 2n ), 

C w c C w i <^=> w ^ w'. 

The Schubert subvarieties of ¥ LJ (F) are the closures of the Schubert cells. The 
Schubert subvariety X w — C w is then given by 

w = LJ w ' ~ 

The Bruhat order on W(Sp 2n ) an d the order on the sets of admissible indices 
■"■fe2n are related by Proctor's criterion (cf. Pro82 ) which states that, for w,w' s 
W(Sp 2n ), w < w' if and only if 

Wi),... 1 iB(i)}t<Hi) l ...y(i)}t 

for all 1 ^ i ^ n. Geometrically this means that, for any V, — (V\ C • • ■ C V n ) 
in ¥ UJ (F), V, € X w if and only if Vi £ XT-icm,...,™^)}! for all 1 ^ i ^ n. In terms 
of the incidence with the flag E, , the Schubert subvariety X w is the set of flags of 
isotropic subspaces V t = (Vi C • • • C V n ) which verify 

dimiViPiEj) ^r w (i,j) 

for all 1 ^ i ^ n and all 1 ^ j ^ 2n. 

3. The odd symplectic group 

Let E be a complex vector space of dimension 2n + 1 and lu £ A 2 _E* a generic 
skew- form on i?. More precisely, we assume that lu is of maximal rank, ie rank a; = 
2n, since the skew-forms of maximal rank form an open orbit under the action of 
the general linear group GL(_E) on A 2 E*. 

Definition 3.1. The odd symplectic group Sp 2rl+1 is the stabilizer in GL(-E) of the 
skew- form lu. 
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Being an isotropy group for an algebraic action, Sp 2n+1 is a closed subgroup 
of GL(E). Let R be the one dimensional kernel of cu with a generator eo, choose 
a supplement F, so that the restriction of lj to F is non degenerate, and take 
{ei, . . . , e 2n } to be a symplectic basis of F . Then in the basis {eo, . . . , e 2n } the 
skew-form u) is given by 

cu(e i ,e j ) = Si t 2n+i-j, f or all s$ i,j < 2n. 

We will call such a basis an odd symplectic basis. We continue to use the notation 
i = In + 1 — % except that now we consider to be not defined. 

With respect to the decomposition R® F = E the odd symplectic group is the 
group of the matrices of the form 



(2) 



where A G C*, a £ Sp 2 „, t € C 2n . From now on, we fix the odd symplectic basis 
{eo, ei, . . . , e 2n } and identify Sp 2n+1 with this group of matrices. 

The symplectic group Sp 2 „ embeds in Sp 2n+1 as those matrices (J2J with A = 1 
and £ = 0. Denote U the subgroup of Sp 2n+1 given by the matrices J2J with A = 1 
and o = l. It is isomorphic to the additive group (C 2 ™, +) and we easily check that 
it is a normal subgroup in Sp 2n+1 . Therefore the odd symplectic group Sp 2n+1 is 
equal to the semi-direct product 

(C* x Sp 2 „) x U 

of his two subgroups C* x Sp 2n and U. It follows that Sp 2n+1 is connected and of 
dimension (n+ l)(2n + l). With the action of C* x Sp 2n by interior automorphisms, 
U is isomorphic to the dual F* of the standard representation of Sp 2 „ (where C* 
acts by homotheties) . 

Since U is a normal unipotent subgroup, it follows that Sp 2n+1 is not reductive. 
Actually U is the unipotent radical R u of Sp 2n+1 , since on the one hand we have 
U C Ru and on the other hand the quotient Sp 2n+1 /C7 ~ C* x Sp 2n is reductive so 
the image of R u in this quotient is trivial. 

We describe now the Borcl subgroups and the maximal tori of Sp 2n+1 . 

Proposition 3.2. Let B be the subgroup of Sp 2n +i of upper triangular matrices in 
the odd symplectic basis {eo, ei, . . . , e 2 „}. Then B is a Borel subgroup. 

Proof. B is solvable since it is a subgroup of the subgroup of upper triangular 
matrices in GL(2n + 1, C). It is given by the matrices of the form 

A 


with a e Sp 2n upper triangular, so B is the semi-direct product B — (C* x -B 2n ) x U 
where B 2n C Sp 2n is the Borel subgroup of Sp 2 „ preserving the flag generated by 
the symplectic basis {ei, . . . , e 2n }. In particular B is connected and therefore it is 
contained in a Borel subgroup B. Since B contains U, it is the semi-direct product 
B=[Bn(C*x Sp 2 ,J] ix U. But Bn(C*x Sp 2 J is connected (since B and U are) 
and solvable and contains C* x B% n . It follows that B PI (C* x Sp 2n ) = C* x B 2n , 
and this means that B = B. ■ 

Proposition 3.3. LetT be the subgroup o/Sp 2n+1 of diagonal matrices in the odd 
symplectic basis {eo, ei, . . . , e 2n }. Then T is a maximal torus. 

Proof. T is a torus since it is a group of diagonal matrices. We have T = C* x 
T 2n where T 2n C Sp 2n is the maximal torus of Sp 2n of diagonal matrices in the 
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symplectic basis {ei, . . . , e 2n }. It suffices to show that T is equal to its centralizer. 
An element 

'A 

of Sp 2n+1 centralizes T if and only if ad — da and £d — t£ for all (t, d) £ C* x T 2n , 
ie a £ C Sp2n (T 2n ) and £ = 0. Since C S p 2ri (T 2n ) = T 2n , we are done. ■ 

Note that the elements of the maximal torus T are the diagonal matrices 

dia,g(t ,ti, . . . ,t n ,t n ,..,,t 1 ), t , . . . ,t n £ C*. 

Remark 3.4. The last proof shows that Cs P2n (T) = T so the Weyl group of 
Sp 2n _|_i is the quotient Ns P2n+1 (T)/T. This is actually isomorphic to the Weyl 
group of the symplectic group Sp 2n . This follows from the fact that Ns P2 ,(T) = 
C* x iVs P , (Tzn), which we can easily check. 

For later use, we record the following : 

Proposition 3.5. The center of Sp 2n+1 is {±Id}. 

3.6. Relating Sp 2n+1 and Sp 2rl+2 . Embed E as a hyperplane in a complex 
vector space E of dimension 2n + 2. Then the odd symplectic form ui extends to a 
symplectic form <I> on E. Indeed it suffices to take a vector eg in E not belonging 
to E and to define uj in such a way that the basis {eo, ei, . . . , e„, ea, . . . , ej, eg} 
be symplectic. Denote simply by Sp 2n+2 the symplectic group which fixes Q. Let 
P be the parabolic subgroup of Sp 2n+2 which preserves the line R. Then P also 
preserves E which is the orthogonal of R, and for any element g £ P the restriction 
g\E preserves uj, ie is in Sp 2n+1 . 

Proposition 3.7. The morphism P — > Sp 2n+1 given by g <—> g\s is surjective. 

Proof. In the symplectic basis {eo, e\, . . . , e n , e^, . . . , ej, eg} an element of P is a 
matrix of the form 

(3) 

with a £ Sp 2n , A, /i £ C*, ^ G C and £,c £ C 2 " a row and, respectively, column 
vector. The condition that this be an element of Sp 2n+1 is that the columns make 
a symplectic basis. Since g\s £ Sp 2r , +1 , we only need to look at the conditions 
involving the last column and this gives Xfi = 1 and, in matrix form, 

(4) [i£ + (c 2 „, . . . , c„+i, -c„, . . . , -c\)a = 0. 

This shows that given any (A, £, a) there is a c such that J2J belongs to Sp 2n+2 and 
we are done. I 

Remark 3.8. In the proof we see that giving (A, t, a) uniquely determines c while v 
is arbitrary. We can show that there is no way of choosing a v for each (A, I, a) such 
that the resulting injection Sp 2rl+1 — ► P be a morphism of algebraic groups, ie the 
morphism P — » Sp 2n+1 has no section. Actually we can show that Sp 2n+1 cannot 
be embedded as an algebraic subgroup in Sp 2 „ +2 . For a proof of these statements, 
see |Mihf)5l ch. 1]. 

Remark 3.9. Through the morphism P — > Sp 2n+1 , the Borel subgroup of Sp 2n+2 
of upper triangular matrices in the symplectic basis {eo, e\, . . . , e n , en, ... , ej, eo} 
surjects onto the Borel subgroup of Sp 2n+1 of upper triangular matrices in the odd 
symplectic basis {eo, e\, . . . , e„, e n , ■ ■ ■ , ej}. Similarly, the morphism P — » Sp 2n+1 
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restricts to an isomorphism between the maximal torus of Sp 2n+2 of diagonal ma- 
trices in the basis {eo, ei, . . . , e„, e^, . . . , ej, eg} and the maximal torus of Sp 2n+1 of 
diagonal matrices in the basis {eo, e\, . . . , e n , e^,, • • • , ej}. 

Remark 3.10. From J2J it follows that the kernel of the morphism P — > Sp 2n+1 is 
the unipotent group of dimension one whose elements are the matrices of the form 

/l ^ N 
(5) 10 

\0 1, 

with v G C. 

3.11. The intermediate odd symplectic group. Since Sp 2n+1 does not em- 
bed in Sp 2n _i_2 as an algebraic subgroup, it is desirable to have an alternative odd 
symplectic group which sits between Sp 2n and Sp 2n+2 . Such a group has been 
introduced by Gelfand and Zelevinski in JGZ84) . They notice that for any complex 
vector space V, the general linear group GL(V) has an open orbit in the space 
V* © A 2 V*, which is 

{(£, 6)\£^0, 6 of maximal rank and ker^ n kei6 = (0)}, 

and they define the group G(V) to be the isotropy group of this orbit. It is easy to 
check that if V is of dimension 2n + 1 then G(V) is isomorphic to Sp 2n , while if V 
is of dimension 2n + 2 then G(V) is isomorphic to the subgroup of Sp 2n+2 which 
fixes a non-zero element of V* (or, equivalently, of V). In the latter case, we will 
use the following designation for G(V): 

Definition 3.12. The intermediate odd symplectic group Sp 2n+1 is the stabilizer 
in Sp 2n+2 of a non-zero element of C 2n+2 . 

Since Sp 2n+1 is well defined up to a conjugation, we can assume that the element 
it fixes is the first vector eo of the symplectic basis {e , ei, . . . , e„, e ft , . . . , ej, eg} so 
that Sp 2ra+1 identifies with the subgroup of the parabolic P considered above given 
by the matrices © with A = /x = 1. Its image via the morphism P — > Sp 2n+1 is 
the subgroup SSp 2n+1 of elements of determinant 1 in Sp 2n+1 . 

4. Odd symplectic flag manifolds 

We introduce here our main objects of study. For a sequence of integers 1 $J 
di < ■ ■ ■ < d r ^ n + 1, denote by V ul (di, . . . , d r ,E) the variety of flags 

{(V dl C ••• C Vd r C E) | dimVdi = di, V d% isotropic for all 1 s^ i ^ r}. 

These are the odd symplectic flag manifolds. 

Let us first note that the condition that the integers di be at most n + 1 comes 
from the fact that n + 1 is the maximal dimension of an isotropic subspace of E. 
Actually, a maximal isotropic subspace of E is always of dimension n + 1 since it 
contains the kernel R and its image in E/R is a maximal isotropic subspace. 

When r = 1 we will write G L0 (k,E) instead of ¥ u (k,E) and call these varieties 
odd symplectic grassmannians. These are simply the grassmannians of isotropic 
subspaces of E. When r = n + 1 we denote ¥ U (E) = F w (l, . . . , n + 1, E) and call 
this, if there is no risk of confusion, the odd symplectic flag manifold. This is the 
variety of maximal flags of isotropic subspaces of E. 

Since the isomorphism class of the variety F Ii ,(di, ...,d r ,E) depends only on 
the dimension of E, we will also denote this variety by ¥ UJ (di, . . . , d r ; 2n + 1) (and 
correspondingly, we will also use the notations G LJ (k : 2n + 1) and ¥ UJ (2n + 1)). 

The variety ¥ ul (di, ... ,d r ,E) is a closed subvariety of F(di, . . . , d r , E), the type 
A flag manifold defined by forgetting the isotropy condition, therefore the odd 
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symplcctic flag manifolds are projective varieties. The odd symplectic group acts 
naturally on the varieties F w (di, . . . ,d r , E), the action being defined by restricting 
to ¥ u ,(d\, . . . , d r , E) the usual action of GL(E) on the flag manifold F(di, . . . , d r , E). 
The major difference between this situation and the one we have in the symplectic 
setting is that this action is not transitive. The reason, as explained in the intro- 
duction, is that the kernel R is fixed by Sp 2n+1 and so flags which do not have the 
same incidence with R cannot be conjugated by Sp 2n+1 (we still have to prove that 
these different incidence types actually occur, but this will become clear below). 
We will show that actually these incidence conditions suffice to describe the orbits. 
Being non homogeneous, it is no longer granted that the odd symplectic flag 
varieties ¥ u {d\, . . . ,d r .E) arc smooth. It turns out that they actually arc: 

Proposition 4.1. The odd symplectic flag manifold F w (<ii, . . . , d r , E) is a smooth 
subvariety of codimension ^d r (d r — 1) in the flag manifold F(rfi, . . . , d r , E). 

Proof. Let T = Td r denote the highest rank tautological bundle on the flag manifold 
F(di, ...,d r , E). The fiber of T at a point V. = (V dl C • • • C V dr ) is V dr . Any 
skew- form 9 G A 2 E* can be seen as a global section of A 2 T*, whose value at a 
point V, = (Vdj C • • • C Vd r ) is the restriction 9\v d G A 2 V d * . In this way the 
section defined by 9 G A 2 E* vanishes at a point V, if and only if Vd r is isotropic 
with respect to 9. Therefore the zero locus of our odd symplectic form u> seen as 
a section of A 2 T* is ¥ w (di, ... ,d r ,E). Now, the vector bundle A 2 T* is generated 
by its global sections which come from A 2 _E* since any skew-form defined on a 
subspacc Vd r extends to E. The section defined by the odd symplectic form u> 
is generic among the sections which come from A 2 E*, so to conclude by Bertini's 
theorem it suffices to show that u> vanishes in at least a point of ¥(d\, . . . , d r , E). 
For this it is enough to take the point (E dl C • • • C E dr ) where E, is the complete 
flag generated by the odd symplcctic basis {e , d, . . . , e 2 „}. ■ 

4.2. Sp 2n+1 -orbits in the odd symplectic grassmannians. Any isotropic 
subspace V C E of dimension n + 1 contains the kernel R and is of the form 
V = R(BW with W C F isotropic of dimension n, so the odd symplectic grassman- 
nian G u (n + 1,E) is isomorphic to the symplectic grassmannian G w (n,i ? ). There- 
fore G^in + 1,E) is already homogeneous under the subgroup Sp 2n C Sp 2n+1 . 
For the other odd symplcctic grassmannians, the Sp 2rl+1 -orbits are given by the 
incidence with the kernel R = Ceo, that is we have: 

Proposition 4.3. For 1 ^ k ^ n the odd symplectic group Sp 2rl+1 acts on the odd 
symplectic grassmannian G u (k, In + 1) with two orbits 

X = {VeGUk,2n + l)\e eV} 
X 1 = {VeG u (k,2n + l)\e $V}. 

The closed orbit Xq is isomorphic to the symplectic grassmannian G u {k — l,2n) 
and the open orbit X\ is isomorphic to the total space of the dual of the tautological 
bundle on the symplectic grassmannian G UJ (k 1 2n). 

Proof. Both Xq and X\ are obviously stable under Sp 2n+1 . Any V G Xq is of the 
form V = R®W with W — VP\F isotropic of dimension k— 1, so Xq is isomorphic 
to the symplectic grassmannian G u (k—l,F) and is already an orbit of the subgroup 

^P2n C op 2n +i- 

Let now p : E — > F be the projection coming from the decomposition E = R®F. 
For any V G X\, p(V) C F is an isotropic subspacc of dimension k. We get in this 
way a map 

p-.Xi—tGufaF) 
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onto the symplcctic grassmannian G UJ (k 1 F) which we regard as a subvariety in 
G u (k,E). If V = (vi, ...,v k ) S X Xl with v % = a 4 e + ^, ^ £ F, then p(V) = 



• ,Vj.). Therefore V and p(V) will be conjugated by any element of the 
unipotcnt radical U of Sp 2rl+1 which sends v[ i— > i^ + c^eo for all 1 ^J z $J A;. 
Such an element exist since the v[ are independent. Conversely, for any g G U 
we have p(g-V) = p(V), and so the orbits of U in X\ coincide with the fibers of 
p : X\ — > G 0J (k, F). In particular, any orbit of t/ in X\ meets G ul (k, F) C Xi which 
is an orbit of Sp 2 „ C Sp 2n+1 , and therefore Sp 2n k [7 C Sp 2rl+1 acts transitively in 

Let now T be the tautological bundle on the symplectic grassmannian G bJ (k 1 F). 
The fiber of the dual T* at a point W G G w (fc, F) is W*. We define a map T* -> X a 
by sending an element £ g W* to its graph I> C IVffiC = W®R G F®R = E which 
is an isotropic subspace of E which does not contain eo and for which p(T{) = W. 
In coordinates, if IV = (toi, . . . , Wk) then Tf = (w\ + £(wi)eo, . . . ,Wk + i(wk)eo). 
Conversely, if V g X\ then V G p(V) © Ceo is the graph of a linear map p(V) — ► 
Ceo = C, ie an element of the fiber of T* at the point p(V). ■ 

4.4. Sp 2n+1 -orbits in the odd symplectic flag manifold ¥ 0J (2n + 1). As for 

the odd symplectic grassmannians, the Sp 2n+1 -orbits of the odd symplcctic flag 
manifold F a) (F) are described by the incidence with the kernel R = Ceo. More 
precisely, we have: 

Proposition 4.5. The odd symplectic group Sp 2n+1 acts on the odd symplectic flag 
manifold ¥ UJ (2n + 1) with n + 1 orbits 

O i = {(V 1 c---cV n+1 )gF w (2n + l) | e e V5,c ^ K-i}, Ki<n + 1. 

Moreover, for all 1 ^ i ^ n + 1, the orbit Oi is isomorphic to the total space of 
the dual T*_ x of the rank i — 1 tautological bundle on the symplectic flag manifold 
F u (2n). 

Proof. The 0j are clearly Sp 2n+1 -stable. Let again p : E — ► F be the projection 
coming from the decomposition E = R® F. For any V. = (Vi C • • • C Ki+i) in 
Oi, the projection p restricts to isomorphisms Vj — > p(V}) for all 1 ^ j ; ^ i — 1, 
and we have Vj — p(Vj) © R with p(Vj) = VjDFiori^j^n+l. We also have 
Vi = Vi-i © F and p(Vj_i) = p(V"j). Let's denote by k(V.) the flag 

Pi (v.) - (p(vi) c • • • c P (v;_i) cViC---c v n+1 ). 

We get in this way a map p$ from Oi onto the closed subvariety Yi C C; 

Fi = {V. = (Vi C • ■ ■ C V„+i) g F W (F) | VI, ... , Vi_i G F, e G V 4 }. 

The subvariety Yj is isomorphic to the symplectic flag manifold ¥ u (F) via the map 
which sends a flag (Wi G • • • C W n ) G F W (F) to the flag 

(Wi G • • • G W;_i G W t -i © F G • • • G W n © R) G K t . 

In coordinates, if {vj,...,^} is an adapted basis for the flag in F W (F) which 
corresponds via the isomorphism above to the flag Pi(V,), then 

{wi,...,w-_i,e , «-,...,<} 

is an adapted basis for Pi(V»), and there are oi, . . . , fl»_ i G C such that 

{t>i + oieo, ■ • ■ , v-_i + Oi_ ieo, e , «-,-■■, v^} 

is an adapted basis for the flag V,. It follows that V, and p»(Vi) will be conjugated 
by any element of the unipotcnt radical U of Sp 2n+1 which sends w' ^-> u' + a^eo 
for all 1 ^ j ^ i — 1. Such an clement exists since t^, . . . , v^ are independent. 
Conversely, for any g g [7 we have p,(V.) = pj(p • V.), so the orbits of [7 in (9, 
coincide with the fibers of pi. Therefore any orbit of U in Oi meets Yi G Oi 
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which is an orbit of Sp 2n C Sp 2n+1 , and so it follows that Sp 2 „ xU C Sp 2n+1 acts 
transitively on Oi. 

Let now Tj_i be the tautological bundle of rank i — 1 on the symplectic flag 
manifold W U (F). The fiber of the dual T?_ x at a point W. = (Wi C • • • C W„) £ 
F W (_F) is W^li- We define a map T^_ x — » 4 by sending an element £ € W^ 
to the flag V, = (Vi C ••• C V n +i) e O l where: V*_i is the graph of I, T e c 
Wi-i © C = Wi_i 8 i? C -F e i? = E; for 1 < j < i - 2, Vj is the graph 1^ C T e 
of the restriction £|vk ; and Vj = Wj-\ © R for i ^ j ^ n + 1. In coordinates, if 
{ui, . . . , i4} is an adapted basis for the flag W, then 

W + ^K) e o, ■ ■ ■ , «,'_i + ^(wi-i)eo, e , «-, . . . , v' n } 

is an adapted basis for V,. Conversely, for V t = (Vi C • • • C V^+i) £ Oi let 
W. = (Wi C • • • C Wn) be the flag in F U1 (F) corresponding via the isomorphism 
F w (F) ~ F, to the flag w (F.) , ie 

W. = (p(Vi) C • • • C p(^i-i) C p(^i+i) C • • • C p(F n+x )). 

Then Vj_i is the graph of a linear map i : Wj_i — > Ceo = C, ie an element of the 
fiber of T*_ 1 at the point W., and we define the inverse map Oi — » T^*_j by sending 
V. to 1 ■ 

Proposition 4.6. TTie closures of the Sp 2n+1 -or6its o/F w (2n + 1) are the subva- 
rieties 

07={(Vi C---CK+i) eF„(2n + l) |e ey}, l^i^n+1 
and are smooth. 

Proof. The first assertion is clear. Now let TTi : ¥ UJ (E) — > G^{i,E) be the map 
(Vi C • • • C Ki+i) i— ► Vi. The image 7Tj(Oi) is the closed Sp 2n+1 -orbit X in the 
odd symplectic grassmannian G u (i, E). For Vi G Xq, the fiber 7r~ 1 (Vi) is isomorphic 
to F(Vi) x ¥ a {y^-/Vi) where u> is the form induced by u on the quotient V^ /Vi. 
For any Vi £ Xo we have dim(V r i ' L ) = In + 2 — i so 7Tj : Oi — > Xo is a fibration with 
fiber F(z) x F w (2(n + 1 — i)) over the smooth base X ~ G w (i - 1, 2n). ■ 

Note that from the second assertion of the proposition 14.51 it follows that Oi is 
of codimension n + 1 — i in F w (2n +1). In particular, O n = F w (2n + 1) \ O n +i is 
an irreducible Sp 2n+1 -stable divisor. 

Remark 4.7. The Sp 2n+1 -orbits in the other ("partial") odd symplectic flag mani- 
folds satisfy the obvious analogs of propositions 14.51 and 14.61 

4.8. Schubert cells in odd symplectic grassmannians. Since the odd sym- 
plectic grassmannian G LJ (k,E) is a subvariety of the usual grassmannian G(k,E), 
it seems natural to try to define "Schubert cells" in G UJ (k,E) by using incidence 
conditions with respect to some fixed flag, ie to take Schubert cells in G(k,E) and 
intersect them with G UJ (k, E). And indeed, if the fixed flag is generated by an odd 
symplectic basis, we can readily show that the "Schubert cells" we obtain in this 
way can be described in terms of row echelon matrices, as for the symplectic grass- 
mannians, and so prove, for example, that they are isomorphic to affine spaces. It 
is then a bit trickier, though, to derive the incidence relations between the cells, ie 
the Bruhat order on the set of cells. Things simplify noticeably once we observe 
that the odd symplectic grassmannian G ul {k,E) can be identified with a Schubert 
subvariety of a symplectic grassmannian G UJ (k, 2n + 2). 

Let indeed, as in 13.61 E be a complex vector space of dimension 2n + 2 which 
contains E as a hyperplane and Q a symplectic form on E which extends ui. Then, 
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clearly, an element V E G UI (k, E) is nothing but an isotropic subspace of E which 
is contained in the hyperplane E, that is, G u] {k 1 E) identifies with the subvariety 

(6) {VeG a (k,E)\VcE}. 

This is a Schubert subvariety in G^(k,E). Let e2 n +i S E be such that the basis 
{eo, . . . ,e2„,e 2n +i} is symplectic and let E, be the flag generated by this basis. 
Then E = E-m+i and in the notation of 12.111 the subvariety (JSJ) is the Schubert 
subvariety -Xj...2j if k < n + 1, respectively Xq^^^I if k = n + 1. We denote by 
max^„ the multi-index of the Schubert variety JHJ that is 

max fc „ = 

We will actually suppose that k and n are fixed and slightly abuse notation and 
write max instead of maxi.„. 

Through its identification with the Schubert variety X max , the odd symplectic 
grassmannian G u (k,E) acquires the cell decomposition of the latter 




u <*■ 



We then define the Schubert cells of G UJ (k, E) (with respect to the flag (E\ C • • • C 
E2n+i)) to be the Schubert cells of Ga,(k, E) (with respect to the flag {E\ C • • • C 
E2n+i C E 2n +2)) which are included in X max . 

We check easily that for / E Ifc2n+2> I = {0 ^ ii < ■ ■ ■ < ik ^ 2n + 1), we have 
I ^ max if and only if ik ^ 2n, that is if I is a multi-index in the set {0, . . . , 2n}. 
So let us introduce the following notation: 

Notation 4.9. Let Ik,2n+i be the set of multi-indices I = (0 ^ i± < ■ ■ ■ < ik ^ 2n) 
and I^2n+i t ne subset of admissible indices, ie indices / such that, for each 1 ^J i ^ 
n, at most one of i or i appears in /. 

Then 1^ 2n +i identifies with the interval {/ E 1% 2n+2 | / $J max} so the Schubert 
cells of G ul (k,E) are parametrized by I^n+i- We state now the characterization 
of the Schubert cells of G UJ (k,E) by incidence conditions with respect to the flag 
(-Ei C • • ■ C E^n+l)'- 

Proposition 4.10. The Schubert cell Ci of G u> {k 1 E) associated to an admissible 
multi-index I E Ife 2 n+i * s ^ e se ^ °f isotropic subspaces of dimension k in E whose 
incidence type is I , ie 

Ci = {V E G u (k,2n+ 1) | dim(V DEi) = a, i a < i < i a +i, 1 < a < k}, 

where we put ik+i = 2n + 1. 

Proof. Indeed, these incidence conditions are obtained from those defining Cj in 
Ga,(k, E) by forgetting the last one (corresponding to i = In + 1), which is super- 
fluous since ik ^ 2n. M 

4.11. Similarly to the symplectic case, the Schubert cell Cj in G ul (k, E) is the set of 
isotropic subspaces of dimension k in E which, with respect to the odd symplectic 
basis {eo, . . . , e2n}, can be generated by the rows of a row-echelon matrix of type /, 
ie a /c x (2n+ 1) matrix (o a j) for which each entry a a i a is non zero and all entries to 
its right are zero. For each V S Cj there is a unique such matrix verifying further 
the conditions that the entries a a i a be 1 and all the entries below be zero. The 
remaining entries are free, except the entries below an entry opposed to a 1 (ie 
below an entry of the form a a — ) which are determined. The free entries provide 
explicitly an isomorphism between C/ and the affine space A dlm Cl . 
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For example, in the odd symplectic grassmannian G w (3, 9) the Schubert cell 
defined by the multi-index (4, 6, 8) = (4, 3, 1) is given by the row-space of the 
matrix 

'****1000 0^ 
***0»100 

**»0»0*ly 

We have marked by * the free entries and by • those which are determined. 

4.12. Let B be the Borel subgroup of Sp 2n+1 of upper triangular matrices in the 
odd symplectic basis {eo, . . . , e 2 „}, ie the subgroup preserving the flag {E\ C ■ • • C 
E^n+i)- From l4.ini it follows that the Schubert cells o£G u (k,E) are B-stable. We 
actually have: 

Proposition 4.13. The Schubert cells of G u (k,E) are the orbits of B. 

Proof. The Schubert cells of G ul (k,E) are orbits of the Borel subgroup B 2n +2 of 
Sp 2n _|_2 of upper triangular matrices in the symplectic basis {eo, . . . , e 2n +i}- But 
B 2n +2 acts on the Schubert subvariety X max through the restriction morphism 
b i— * b\E, and the image of B 2n+2 via this morphism is B. I 

4.14. We equip I£. 2n+1 vvith the order relation for which / < J if and only if 
ia ^ ja for all 1 ^ i ^ k. This corresponds with the order on I£ 2n+2 when we 
identify 1% 2n+1 with the interval {/ G I%2n+2 I ^ ^ max}. It follows that the order 
on I£ 2,1+1 describes the Bruhat order on the set of Schubert cells of G UJ (k, E), that 
is, for alii, Jel^ 2 „+i. 

Ci c C~, ^=^ I^J. 

4.15. Define the Schubert subvarieties of the odd symplectic grassmannian G u (k, E) 
to be the closures of the Schubert cells. Since the Bruhat order on the set of Schu- 
bert cells agrees with the order on I£ 2n+1 , the Schubert subvariety Xi = Ci verifies 

Xi=\J Cj. 

Therefore, in terms of the incidence with the flag {E\ C • ■ ■ C E 2n+ i), the Schubert 
subvariety Xi is characterized by 

Xj = {V eG„{k,E) | dim(VnE ia ) > a, 1 < a ^ k}. 

4.16. The Picard group of the odd symplectic grassmannian G ul (k, E) is Z. Indeed, 
since Guj(k,E) has a cellular decomposition, the Picard group coincides with the 
free abelian group generated by the classes of the closures of the codimension 1 cells. 
In Gu(k, E) there is only one codimension 1 cell, ie only one Schubert divisor. We 
can easily check that, for 1 ^ k ^ n, the Schubert divisor is 

^I+T^T...2i = {V e G u (k, E) I v n E 2n _ k+1 ± 0} 

and, for k = n + 1, it is 

X n^T...2l = {Ve G u (n + 1, E) | dim(^ n E n+1 ) > 2}. 

4.17. Schubert cells in the odd symplectic flag manifold F w (2n + 1). In 
order to define the Schubert cells in the odd symplectic flag manifold F w (2n + 1), 
we proceed, as in the case of the odd symplectic grassmannians, by first identifying 
F w (2n +1) to a Schubert subvariety in a symplectic flag manifold F w (2n + 2). 
With the same notations as in 14.81 a flag V, € ¥ U ,(E) is the same thing as a flag 
V* G ¥q(E) for which V n +i C E, that is, ¥ LJ (E) identifies with the subvariety 

{(V x C • • • C V n+1 ) G ¥ Q (E) | V n+1 c E}. 
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This is a Schubert subvariety in ¥q (E) . With respect to the flag (E\ C • • • C 
E 2n+2 ), and in the notation of 12. 141 this is the Schubert subvariety X\ 2 M0 associ- 
ated to the signed permutation 12 . . . nO G W(Sp 2n+2 ). 

Identifying then ¥ U (E) with Xj 2 n0 , we define the Schubert cells oi¥ u! (E) (with 
respect to the flag {E\ C • • • C i?2n+i)) to be the Schubert cells of ¥q(E) (with 
respect to the flag (E\ c • • • C Ezn+i C E 2n+2 )) which are included in X\2...m- 

The Schubert cells of ¥ UI (.E) are therefore parametrized by the interval 

{weW(Sp 2n+2 )\w^l2...nO} 
in the Weyl group W^(Sp 2 „ + 2) of Sp 2n+2 - We introduce the following notation: 

Notation 4.18. We denote the interval {w G W{Sp 2n+2 ) I w ^ 12... nO} by 

W(Sp 2n+1 ). 

This notation is somewhat misleading since it might suggest that H^(Sp 2n+1 ) is 
the Weyl group of Sp 2 „ +1 . Of course, W(Sp 2n+1 ) is not a group at all, and the 
Weyl group of Sp 2 „ +1 coincides with the Weyl group of Sp 2n . 

Proposition 4.19. The elements of W(Sp 2n+1 ) are precisely those signed per- 
mutations which in the one-line notation do not contain 0, ie those w for which 
Oi{w(0),w(l),...,w(n)}. 

Proof. Let w G W (Sp 2n+1 ) . We have w ^ 12 . . . nO if and only if the Schubert cell 
C w is contained in X\ 2 fi0 which is equivalent to E™ G Xf% n0 , where E™ G C w 
is the flag generated by the basis {e^m^e^m,... ,e w i n )}- By the definition of 
the Schubert subvariety X\ 2 m this is equivalent to w(i) G {0,1,..., 2n} for all 
^ i ^ n and we are done. I 

4.20. We derive now the characterization of the Schubert cells by incidence con- 
ditions with respect to the flag (Ei C ••• G E 2n+ i). Let us first note that if 
w G W (Sp 2n+1 ) G W (Sp 2n+2 ) then, by the last proposition, the rank function r w 
of w is determined by its restriction to the rectangle {0, . . . , n} x {0, . . . , 2n}. 

Proposition 4.21. The Schubert cell C w of¥ LJ (E) associated to w G W(Sp 2n+1 ) 
is the set of flags of isotropic subspaces V, — (V\ G • • • C V^+i) which verify 

dim(Vi HEj) = r w (i,j) 

for all ^ i $J n and ^ j ^ 2n. 

Proof. These conditions are obtained from those defining C w in ¥q(E) by forgetting 
the case j = 2n + l for which the conditions are automatically verified since V n +\ G 
E and w G W(Sp 2n+1 ) C ^(Sp 2n+2 ). ■ 

4.22. Analogously to the symplectic case, the Schubert cell C w in ¥ UJ {E) is the 
set of flags of isotropic subspaces which, with respect to the odd symplectic basis 
{eo, . • • , e 2n }, have an adapted basis given by the rows of a (n + 1) X (2n + l) matrix 
(aij) for which a iw ^ = 1 and a^ — for all sj i ^ n and ^ j ^ 2n, j > w(i). 

4.23. From l4"2"Tl it follows that the Schubert cells of ¥ LU (E) are stable under the 
Borel subgroup B of Sp 2n+1 which preserves the flag {E\ G ■■• G E 2n+ i). We 
actually have: 

Proposition 4.24. The Schubert cells of¥ UJ (E) are the orbits of B. 

Proof. The Schubert cells of ¥ ul (E) are orbits of the Borel subgroup B 2n+2 of the 
symplectic group Sp 2n+2 which preserves the flag {E\ C • ■ ■ G E 2n+ \ C E 2n+2 ). 
The assertion follows since B 2n +2 acts on Xj 2 m trough the restriction morphism 
b h^ b\E and the image of B 2n+2 via this morphism is B. M 
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4.25. We equip the subset W(Sp 2n +i) C W^(Sp 2 „ +2 ) with the order induced by the 
Bruhat order of the Weyl group W(Sp 2n+2 ). I n this way, the order on W(Sp 2n +i) 
describes the Bruhat order on the set of Schubert cells of ¥ U1 (E), that is, for all 

w,w' eV^(S P2n+1 ), 

C w C C w i <^=> w ^ w'. 
Define the Schubert subvarieties of the odd symplectic flag manifold ¥ U ,(E) to be 
the closures of the Schubert cells. For w G W(Sp 2n+ i), the Schubert subvariety 
X w = C w is then given by 

w = LJ w> ' 

w' ^w 

In terms of the incidence with the flag {E\ C • • • C -E 2n +i), the Schubert subvariety 
X w is the set of flags of isotropic subspaces V, — (V\ C • • • C V n+ i) which verify 

for all ^ i ^ 7i and ^ j ' ^ In. 

4.26. We can count the Schubert cells of ¥ UJ (E) of a given dimension of and thus 
compute the Poincare polynomial of ¥ LJ (E). We have: 

Proposition 4.27. The Poincare polynomial of the variety ¥ U (E) is 

(q n+l - l)(q 2n - l){q 2n - 2 - 1) ... (q 2 - 1) 



(7) P(¥ u (E),q) = 



(q-i) 



Since 2, 4, ... , 2n, n + 1 are the exponents of the Weyl group W(D n+ i) of type 
D„_|_i (cf. jBou 68 ), it follows that Q coincides with the Poincare polynomial of 
the flag variety G/B for G of type D„+i. We prove this proposition in |Mihj where 
we also show that ¥ U] (E) and G/B with G of type D„ + i have actually the same 
singular cohomology rings. 

5. The automorphism group of an odd symplectic grassmannian 

We compute here the automorphism group of the odd symplectic grassmannian 
G u> (k,E). If k = 1 then G^(1,E) is just the projective space ¥E and its auto- 
morphism group is PSL 2n+ i. If k = n + 1 then, as seen in 14.21 the odd symplectic 
grassmannian G u (n+1, E) is isomorphic to the symplectic grassmannian G^fa, F), 
and so its automorphism group is PSp 2n . For the remaining cases we have the fol- 
lowing result: 

Proposition 5.1. For 2 $J k ^ n, the automorphism group of the odd symplectic 
grassmannian G U! (k, 2n + 1) is PSp 2 „ +1 = Sp 2n+1 /{±1}. 

The proof we will present here is inspired from a now standard method of com- 
puting the automorphism group of the usual grassmannian (see for example Har95 
10.19]) and relies on an analysis of the linear spaces contained in G UJ (k, E). 

But before filling in the details, let us mention that there is a different, quite 
straightforward way to compute the Lie algebra of this automorphism group. This 
method is detailed in |Mih05[ §2.3.1] and roughly consists of the following steps. 
First of all, the Lie algebra of the automorphism group of G u (k, E) coincides with 
the space of global sections of the tangent bundle H Q (G UJ (k 1 E),TG ul (k, E)) (cf. 
Akh95, §2.3]). In order to compute this we use the description of G w {k, E) as the 
zero locus of u seen as a generic section of the bundle A 2 T* on the grassmannian 
G(k, E). Then the differential of this section identifies A 2 T* with the normal bundle 
of G ul {k, E) in G(k, E), so that the space of global sections we want to compute is 
the kernel of the map 

(8) H°(GUk,E),TG(k,E)\ GUkE) ) ^ H°{GUk,E),A 2 T*\ G ^ E) ). 
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We now use the Koszul complex associated to the section u> to derive resolu- 
tions by locally free sheaves on the grassmannian G(k, E) for the two restrictions 
TG(k, P)|G„(fc,£) and K 2 T*\ Gui ^ k ^ E y With the help of Bott's theorem we prove that 
these resolutions are acyclic, so that taking the global sections yields resolutions 
for the two spaces in ©. Specifically, © becomes 

(9) si{E) — > A 2 E*/uj 

where the map is sending an element X G sl(E) to the image in A 2 E* /oj of the 
transform X ■ uj corresponding to the s[(P)-module structure of A 2 E* . The kernel 
of © is then the Lie algebra {X € sl(E) \ X ■ oj 6 Ccj} which identifies with 
{X e gl(E) \X-u£ Cuj}/Cld and so with sp 2n+1 = {lc Ql(E) \ X ■ uj = 0} (as 
Lie algebras, and not only as vector spaces, since Id is central in qI(E)). The Lie 
algebra of the automorphism group of G ul (k, E) is therefore sp 2n+1 . 

5.2. We now proceed with our proof of proposition 15.11 The outline of the proof 
is the following. First we show that, in its Pliicker embedding via the inclusion 
G UJ (k, E) C G(k, E), all the automorphisms of G^ik, E) come from automorphisms 
of the ambient projective space. This implies in particular that any automorphism 
of G UJ (k, E) induces automorphisms of the Fano schemes of linear spaces contained 
in G u (k,E). It turns out that a certain Fano scheme of G^ (k,E) is either irreducible 
or has two non-isomorphic irreducible components, and in both cases one of its 
irreducible components is isomorphic to the blow-up of G UJ (k — 1, E) along its closed 
Sp 2n+1 -orbit. We show then that any automorphism of this Fano scheme coming 
from an automorphism of G u {k,E) induces further an automorphism of G ul (k — 
l,E). Iterating this, any automorphism of G u] {k 1 E) induces an automorphism 
of G U (1,E) = FE, that is, an element of PSL 2n+ i, which, as it comes from an 
automorphism of G u (2, E), will be shown to be in PSp 2n+1 . Finally, we show that 
the initial automorphism of G ul (k, E) coincides with the automorphism induced by 
this element of PSp 2n+1 . 

5.3. Let's start with some preliminaries. We first recall Bott's theorem in the 
particular case of the grassmannian G(k, E) which will be used below. Let P& C 
SL 2n _|_i be the parabolic subgroup which preserves the space generated by the last 
k vectors of the basis {eo, . . . , e 2 „}, so that G(k,E) = SL 2 „ + i/Pfc. In SL 2n _|_i 
we fix the maximal torus of diagonal matrices in the basis {eo, . . . , e 2n } and the 
Borel subgroup of upper triangular matrices in the same basis; the parabolic P& 
contains then the opposite Borel subgroup. The weights of SL 2n+ i identify with 
the tuples A = (Ao, ■ ■ ■ , A 2n ) modulo shifts (Ao, ■ ■ ■ , A 2 „) i— > (Ao + a, . . . , A 2n + a). 
A weight A = (Ao, . . . , A 2n ) is singular if it has two equal parts and dominant if 
Ao ^ • • • ^ A 2n . In the latter case, if the A^ are non negative, we see A as a partition 
and denote |A| = ^ \ its weight and ^(A), the number of non zero parts, its length. 
For A dominant, the simple SL 2n+ i-module with highest weight A is isomorphic to 
the Schur power S\E. 

Irreducible homogeneous vector bundles on G(k, E) are determined by irre- 
ducible Pfc-modules, which in turn are determined by P^-dominant weights, that 
is weights A = (Ao, . . . , A 2 „) such that Ao ^ ■ • • ^ A 2n _fc and A 2rl _fe+i ^ • ■ • ^ 
A 2 „. If T and Q denote the tautological, respectively the quotient, bundles on 
the grassmannian G(k,E), whose fibers at a point V € G(k,E) are V, respec- 
tively E/V, then the irreducible bundle corresponding to a P^-dominant weight 
A = (Ao, • • • , A 2n ) is given in terms of Schur powers of T and Q by 

E x = SyQ®S x »T, 

where A' = (A ^ • • • ^ A 2n _ fe ) and A" = (A 2 „_ fe+ i > • • ^ A 2n ). 
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The Weyl group of SL2„+i is isomorphic to the permutation group S^n+i an( i ac ts 
on weights by w (X , . . . ,X 2n ) = (A w -i( ), • • • , A ro -i (2n) ). Let p = (2n + l,2n, . . ., 1) 
denote the smallest strictly decreasing partition, which modulo a shift coincides 
with the half-sum of the positive roots. For A a Pfc-dominant weight, the cohomol- 
ogy of the associated irreducible bundle E\ is described by Bott's theorem: 

Theorem. If X + p is singular then H t (G(k,E),E\) — for all i. If not, let 
w G Szn+i be the unique permutation such that w(X + p) is dominant, and let £ 
be its length. Then H (G(fc, E), E\) is the simple SL2„+i -module of highest weight 
w{X + p)-p and H l (G{k, E),E X ) = for all i ^ t 

We'll also need the plethysm formula for the decomposition of A J (A 2 y) as a 
GL(y)-module. Recall first that the Frobenius notation A = (ai, . . . , a r | bi,...,b r ) 
for a partition A encodes its hook decomposition, that is, in the Ferrers diagram of 
A there are ai boxes to the right of the i-th box on the diagonal and hi boxes below. 
The rank r of A is the number of boxes on the diagonal. We have (cf. |Mac95| ) 

(10) A*(A 2 V) = 0S A -V 

|A|=t 

where the sum is indexed by all strictly decreasing partitions of weight i and for a 
strictly decreasing partition A we denote 

A = (Ai — 1, . . . , Xg — 1 | Ai, . . . , Xi). 

5.4. We embed G w (k,E) in G(k,E) and further, via the Pliicker embedding of 
G{k, E), in FA k E. We set out to prove that any automorphism of G u] (k, E) comes 
from an automorphism of the ambient projective space VA k E. 

Proposition 5.5. The embedding G ul {k,E) C VK k E is linearly normal, that is, 
the restriction morphism 

H (¥A k E,O PAkE (l)) — > H Q (G„(k,E),0 G „ {k , E )(l)) 
is surjective. 

Proof. To simplify the notation, we write G instead of G(k, E) and G w instead of 
Guj(k,E). The line bundle 0(1) on G corresponding to the Pliicker embedding is 
isomorphic to detT*. Since H°(G,dctT*) = A k E*, it suffices to show that the 
restriction morphism 

(11) H (G,O G (l)) ^ H°(G^,O g M)) 

is surjective. We regard G w as the zero locus of u> seen as a section of the bundle 
A 2 T* on G. We consider the Koszul complex of uj which we twist by det T* and 
obtain the exact complex 

(12) — > A r (A 2 T)®detT* — ► > A 2 (A 2 T) ® detT* — > 

— > A 2 T®detT* — >detT* — >detT*| G ^ — >0 

where r = \k[k — 1). To obtain the surjectivity of l|ll|l it suffices to show that 
this complex is acyclic, ie that the bundles in (|12|l have no higher cohomology (this 
follows in a standard way by chopping (|12l) into short exact sequences and using 
the corresponding cohomology long exact sequences). By l|10(l . we have 

A J (A 2 T) ® det T* = S x - T ® det T* 

|A|=i 

so any irreducible component of A J (A 2 T) ® detT* is of the form E v = S^T where 
M = (^1 ^ ' ' ' s* Mfe) is the skew partition (A^" — 1, . . . , Ar — 1) for some strictly 
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decreasing partition A of weight j. Then 77 = (0, 0, . . . , 0, fi\, . . . , pk) and 

V + P = (2«- + 1, 2n, . . . , k + l,^i + fc, . . . ,/ife + 1). 

Consider first the case j ^ 2. By construction, we have £{X~) = Ai + 1 and X^ = X±. 
As T is of rank fc, ^(A~) ^ k, since otherwise S\-T = 0, so Ai ^ k — 1. Therefore 
/ii+/c = Ai — f + fc^2fc — 2^2n+f. On the other hand, since |A| = j ^ 2 and 
A is strictly decreasing, we have Ai ^ 2 and so /ii + k = Ai — 1 + k ^ k + 1 . The 
partition r/ + p has therefore two equal parts and so is singular. By Bott's theorem, 
it follows that 

H l (G,A j (A 2 T) (g) detT*) = for all i. 

For j = l, the bundle A 2 T ® detT* = A fc ~ 2 T* is given by a dominant weight and 
therefore has no higher cohomology. Similarly for j = and the bundle det T* , and 
we are done. ■ 

Proposition 5.6. Any automorphism of the odd symplectic grassmannian G UJ {k, E) 
is induced by an automorphism of the ambient projective space ¥A k E. 

Proof. This follows by a standard argument (as in Har77, Example 7.1.1], for 
example) from the fact that G UJ (k,E) is linearly normal in ¥A k E and its Picard 
group is Z. ■ 

5.7. Denote by A^E the kernel of the contraction \_u> : A k E — > A k ~ 2 E. Since 
H°(G,A k ~ 2 T*) = A k ~ 2 E*, taking global sections in fl^|) and using the vanishings 
from the proof of 15. 51 we get the exact sequence 

— » A k - 2 E* --> A k E* — » H°(G u ,0 Gu (l)) — » 0. 

Taking the duals, we obtain i?°(G w , C Gw (1))* = A^ E so G a (k, E) embeds in the 
projective subspace FA^E C FA k E as a non-degenerate subvariety. We actually 
have: 

Proposition 5.8. G u {k,E) = G(k,E) nPA^E. 

Proof. Let V £ G(k, E) and {v\, . . . , Ufe} a basis of V. The contraction of v\ A- ■ ■ Aw^ 
by w is explicitly given by 



y \ — ±j - ujyui, uj )u\ /\ • • • i\ ui 1 \ • • • /\ uj 



(vi A • • • A Vfc)i_w = y^ (-l)' l+] uj{vi, Vj)vi A • • • A Vi A • • • A Vj A • • • A «& 



so v\ A ■ • • A Ufc is in the kernel of lu if and only if V is isotropic. I 

Note, though, that the intersection in 15.81 is not transverse. Let us denote by 
Aut(PA^i?, G lAj (k, E)) the group of automorphisms of the projective space fA^E 
which preserve G^^k^E). We have natural morphisms 

PSp 2 „+i — ► Aut (FA^E,G^{k,E)) — > Aut (G u (k,E)). 

The second morphism is an isomorphism, since it is surjective by 15. 61 and injective 
since Guj(k,E) is non-degenerate in PA^ k 'E. The first morphism is injective, since 
any line in E is recovered as the intersection of all the fc-dimensional isotropic 
subspaces which contain it. Therefore, to conclude our proof of 15. II it suffices to 
show that the first morphism is surjective. 

We start analyzing the linear spaces contained in G LJ (k,E). We recall first the 
description we have in the case of the grassmannian G(fc, E) (cf. Har95, 6.9]): 

Proposition 5.9. A maximal linear space contained in the grassmannian G(k, E) 
is either of the form 

{VeG{k,E) I VdV^ 1 } 
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for some subspace V k ~ 1 C E of dimension k — 1, or of the form 

{VeG(k,E) | V cV k+1 } 

for some subspace V C E of dimension k + 1. 

For the odd symplectic grassmannian G u> {k, E) we have: 

Proposition 5.10. The maximal linear spaces contained in G U! (k,E) are of one 
of the following two types: 

{p2(n— k)+2 -f T/fc— 1 -J „ 

/or an isotropic subspace V k ~ x C E of dimension k — 1. 
type II: {V € G.(fc^) | V C ^} = K ^ +1 /^f 

/or a subspace V k+1 <Z E of dimension k + 1. 

Proof. Since the odd symplectic grassmannian G w (fc,_E) is cut in G(k,E) by a 
linear space (cf. 15.80 . the maximal linear spaces contained in G w (/c,-E) are simply 
the intersections of G U! (k 1 E) with the maximal linear spaces contained in G(k,E). 
Let L be a maximal linear space contained in G(fc, f?) of the first kind described 
in EH that is, L = {V e G(k,E) | V D V^ 1 } for some subspace V k ~ 1 cEof 
dimension k — 1. If V^ fc_1 is not isotropic then L n G UJ (k,E) = 0. Suppose that 
I/ fc -i is isotropic and let V be a point of L. If V is isotropic then V C (V k ~ 1 ) ± 
and, conversely, if V C (V k ~ 1 )- L then V^ is isotropic, so 

LDG u ,(k,E) = {V eG(k,E) \ V^ 1 CV C (V^ 1 )- 1 } ~ P^V*- 1 )- 1 /^- 1 ). 

If V^ -1 does not contain the kernel R of u> then dim(y fc_1 ) ± = 2n — k + 2 and 
p^yk-ijjyyfe-i) ^p2n-2fc+2_ jf yk-l contains i? then dim^- 1 ) 1 ^ = 2n-k + 3 
and f{{V k - 1 )^/V k - 1 ) ~ p 2 "- 2fc +3. 

Let now I be a maximal linear space contained in G(k, E) of the second kind 
described in !5.9l that is, L = {V6 G(k, E) \ V C V k+1 } for some subspace V k+1 C 
E of dimension k + 1. The intersection L n G UJ (k, E) is then the grassmannian of 
isotropic hyperplanes in V k+l . By the lemma below we have three possibilities, 
according to the rank oiu)\yk+i: If V k+1 is isotropic then 

L(lG UJ (k,E) = L = {V<EG(k,E) | V cV k+1 }~P k ; 

If rank(w|yfe+i) = 2 then 

LDG^k^E) = {VE G(k,E) | KerH yfe+1 ) cR V k+l ) ~ P 1 ; 

If rank(w|yfc+i) > 2 then L n G u (k, E) = 0. This concludes the proof. ■ 

Lemma 5.11. Let W be a space equipped with a non zero skew-form uj. If 'rankw = 
2 then the isotropic hyperplanes of W are precisely those which contain Kerw. If 
rankw > 2 then there is no isotropic hyperplane in W . 

Proof. Denote still by u> the canonical morphism lo : W — > W* . We write _L W 
to denote the orthogonal with respect to u> and _L to denote the orthogonal with 
respect to the duality W ® W* — > C. Let H C W be a hyperplane. Then 

# isotropic ^=^ H C i/- 1 - = ^(H)- 1 ^=^ H^ D uj(H). 

Since dimii^ = 1, this is equivalent to oj(H) = or ui(H) = H . We cannot have 
<jj{H) = since Keioj is of codimension at least 2. If a; (if) = H 1 - then Kerwni? is 
a hyperplane of if so codimKcru ^ 2, and so codimKerw = 2 and Kcro; C H . ■ 
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5.12. The linear spaces contained in G w (k,E) which will prove useful in our com- 
putation of the automorphism group of G UJ (k, E) are those of dimension 2(n — k) + 2. 
Recall that for a projective variety X C V N and an integer t £ N, the Fano scheme 
F(£, X) is the subvariety of the grassmannian G(£, N) of P e, s in P^ parametrizing 
the linear subspaces of P^ of dimension £ contained in X. 

In what follows we will focus on the Fano scheme F(2(n — k) + 2,G U) (k,E)) of 
linear spaces of dimension 2(n — k) + 2 contained in G u> {k, E). For simplicity, we 
will denote it F. 

Proposition 5.13. If k < |(n + 1) then the Fano scheme F parametrizing the 
p2(?i-fc)+2 ? g contained in G ul (k,E) is irreducible and isomorphic to the variety 

F 1 = {(V k -\H) £G„(k-l,E) xG(2n-k + 2,E) \ V^ 1 CH C {V k ~ 1 )- L } 

which identifies to the blow-up of G UJ {k — 1,E) along its closed Sp 2n+1 -orbit. 

Ifk ^ |(n+l) thenF has two disjoint irreducible components: one is isomorphic 
to the variety F 1 above, the other is isomorphic to the variety 

F 2 = {{W,V k+1 ) £G{3k-2{n+l),E) xG u {k + l,E) \ W C V k+l ) 

and these two components are not isomorphic. 

We will prove this proposition in several steps. First, a little piece of terminology. 
Any p 2 ( n ~ fe )+ 2 contained in G w (k,E) is included in some maximal linear space 
contained in G UJ (k, E). If the maximal linear space is of type I (according to 15. 10(1 
then we will say that the p 2 (™- fc )+ 2 j s of the first kind. Otherwise, ie if the maximal 
linear space is of type II, we will say the p 2 (™- fe )+ 2 i s f the second kind. Note that 
this terminology is coherent, that is, a p 2 (™- fe )+ 2 cannot simultaneously be of the 
first and of the second kind since the intersection of a type I maximal linear space 
with a type II maximal linear space is contained in a P 1 : 

{V £G ul {k,E) | V*" 1 cV c {V*- 1 ^} D {V £ G u (k,E) | V dV k+l ) C 

C {V £G{k,E) | V k - X aV dV k+l ) kP 1 . 

Note also that if k < 2(n — k) + 2, or equivalently k < |(?i + 1), then from the 
definition it follows that there is no p 2 ("~ fe )+ 2 f the second kind. 

Lemma 5.14. The p 2 ( n ~ fe )+ 2 ' s of the first kind are parametrized by the variety F 1 . 

Proof. Consider a p 2 ("-' £ )+ 2 G f the first kind. If it is maximal, then according to 
15. 1UI it is determined by giving a V k ~ x isotropic of dimension k — 1 which does not 
contain cq. If it is not maximal then it is a hyperplane in a maximal p 2 (™- fe )+ 3 
of type I, ie it is determined by giving a V k ~ 1 isotropic of dimension k — 1 which 
contains eo and a hyperplane H of (V k ^ 1 ) ± which contains V k ~ 1 : 

p2 («-fc)+2 = { V £ G(k,E) | V k - X c V c H c (V k - 1 ) ± }. 

Now consider a point {V k ~ 1 , H) £ F 1 . If V k ~ l $ e then dim(I/ fe " 1 ) ± = 2n-fc+2, 
so H = (V k - 1 ) ± . If V k - X 3 e then dim(F fc - 1 ) ± = 2n - k + 3 and so H is a 
hyperplane in (V^* -1 )^. This shows that any p 2 (™- fc )+ 2 f the first kind is of the 
form 

(13) {V £ G(fc, E) | V k ~ l C V C H} 

for some (V k ^ 1 ,H) £ F 1 . Conversely, any linear space of the form 1)13(1 is a 
p2(n-fc)+2 con tai ne d in G UJ (k, E), and we are done. ■ 

Lemma 5.15. The p 2 ("- fe )+ 2 >$ f the second kind are parametrized by F 2 . 
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Proof. A p 2 (™- fc )+ 2 of the second kind is included in a maximal P fe of type II, so, 
according to 15. 101 it is defined by giving a V k+1 isotropic dimension k + 1 and a 
subspace y 3fe - 2 ( n + 1 ) c V k+1 of dimension 3fc - 2(n + 1): 

(14) p2(n-fc)+2 = {y e G(fc, 2?) | i/ 3fe - 2 (" +1 ) c V C V fc+1 }. 

Conversely, any linear space of the form (|14|l is contained in G UJ (k, E). ■ 

Lemma 5.16. The projective variety F 1 is isomorphic to the blow-up of the odd 
symplectic grassmannian G u (k — 1,2?) along its closed Sp 2n+1 -or&zi. 

Proof. Let p : F 1 — > G w (fc — 1,2?) denote the projection on the first factor, and let 
V k ~ 1 G G u] {k — l,E). From the discussion in the proof of lemma 15.141 it follows 
that if V k - X $ e then the fiber p- 1 (V k ~ 1 ) reduces to the point {V k ~ 1 , (V k - 1 ) ± ) 
and if V k ~ 1 3 eo then the fiber p~ 1 (V k ~ 1 ) identifies with 

{H | H hyperplane in (V k - 1 ) ± ,H D V*' 1 } = ¥((y k ~ 1 ) x /V k ~ 1 )* . 

So, above the open Sp 2n+1 -orbit X\ C G L0 (k — 1, E) the projection p is an isomor- 
phism, and above the closed Sp 2rl+1 -orbit Xq C G UJ {k — 1, E) it is a fibration with 
fiber p2«-2fc+3_ 

Since Xq is of codimension 2n — 2k + 4 in G UJ (k — 1, E) it follows that p _1 (Xo) 
is a divisor in F 1 , and to prove that F 1 is the blow-up of Xq in G UI (k — 1,25) it 
suffices to show that F 1 is smooth (cf. JGH78I Ch. 4,§6]). We will show that F 1 is 
the zero locus of a sufficiently generic section of a vector bundle on the partial flag 
variety 

W(k-l,2n-k + 2 7 E) = {{V k ~ 1 ,V 2n - k+2 ) \ V^ 1 c y 2n - k+2 c E) 

(with the convention, implicitly used already, to write dimensions as superscripts). 
Note that this flag variety is a component of the Fano scheme F(2(n— fc)+2, G(k, E)) 
parametrizing the p 2 0-fc)+2> g contained in the grassmannian G(k,E). 

For simplicity we denote in what follows a = k — 1 and b = 2n — k + 2. Let 
T a and T b be the tautological bundles on the flag variety F(a, b, E) whose fibers at 
a point V = (V a C V b ) e ¥(a,b,E) are V a , respectively V b . The skew-form u 
defines a section of the bundle (T Q )* ® (T b )* whose value at the point (V a C V" 6 ) 
is the restriction of u) to the subspace V a x V b C E x E. 

A point (V a C F 6 ) of ¥(a,b,E) is in F 1 if and only if V a is isotropic and 
yb c (y a )\ which is equivalent to V b C (1/°)^ since F° C V b . In other words, 
F 1 is the zero set of the section u £ H°(¥(a, b, E), (T a )* ® (T 6 )*). But the bundle 
(T a )* ® (T b )* is not suitable for our purpose since its rank is too big. We replace 
it by a subbundle of which ui is still a section. Let 8 be the kernel of the surjective 
morphism (T Q )* ® (T b )* -* S 2 (T a )* given by the composition (T a )* ® (T b )* -> 
(T a )* <g> (T a )* -> S 2 (T a )*. Then sections of (T Q )* ® (T fc )* which come from A 2 S* 
are sections of £ , as is the case in particular for u> G A 2 i?*. The fiber of £ at a point 
(]/ a c F 6 ) identifies, in a basis adapted to the flag V a C V b , to a x b matrices of 
the form 

(AB), A antisymmetric. 

Such a matrix can always be completed to a (2n + 1) x (2n + 1) antisymmetric 
matrix 

'A B 



which shows that £ is generated by its global sections which come from A 2 E* . Since 
u> is generic in A 2 E* and F 1 is non empty, we conclude by Bertini's theorem. ■ 
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The projective variety F 2 is a fibration in grassmannians G(3fc — 2(n + 1), fc + 1) 
over the odd symplectic grassmannian G UJ (k + 1, E), it is then smooth, irreducible, 
of dimension 

dimF 2 = dimG w (fc + 1,E)+ dimG(3fc - 2(n + 1), k + 1) 

= (ft + l)(2n - fc) - ( k I" 1 J + [3ft - 2(n + l)][2(n - ft) +3]. 

On the other hand, the variety F 1 is birational to the odd symplectic grassmannian 
Gui (k — 1, E), so it is irreducible, of dimension 

'ft-T 



dimF 1 = dimG w (fc- 1,E) = {k - l)(2n-fc + 2) - 

We have then 

dimF 2 -dimF 1 = [3ft - 2(n + l)][2(n - ft) + 1] -1 

so dimF 1 = dimF 2 only when n = k = 3, in which case F 1 and F 2 are both of 
dimension 9. 

Lemma 5.17. When n = ft = 3, the varieties F 1 and F 2 are not isomorphic. 

Proof. We have 

F 1 = {(V 2 ,H 5 ) GG W (2,7) xG(5,7) \V 2 cH c (V 2 )^} 

F 2 = {(ly 1 ,^ 4 ) GG(1,7) xG u (4,7) | T^ 1 c V 1 }. 

The variety F 1 is the blow-up of G u (2,7) along the closed Sp 7 -orbit which is iso- 
morphic to G u (l, 6) ~ P 5 , so the exceptional divisor of F 1 is a fibration in P 3 over 
P 5 . The variety F 2 is a fibration in G(l, 4) ~ P 3 over the odd symplectic grassman- 
nian G w (4, 7). Note that the varieties F 1 and F 2 are both smooth of dimension 9 
and of Picard group Z 2 . We show they don't have the same singular cohomology. 
If p : F 1 — > G LLl (2, 7) is the canonical projection and D — p _1 (P 5 ) the exceptional 
divisor, then, as Z-modules, we have (cf. |GH78I Ch. 4, §6]) 

J ff*(F 1 ,Z)~iJ*(G w (2,7),Z) © H*{D,Z)/H*(P 5 ,Z). 

The Z-module H*(G U (2, 7),Z) is free, generated by the classes of the Schubert 
subvarieties of G u (2, 7). It is of rank #1^7 = 18. Since p : D — ► P 5 is a fibration in 
p3 over P 5 ; thc ring h*(D,"L) is a free H*(V 5 , Z)-modulc of rank 4 (cf. |GH78| ). 
As iJ*(P 5 ,Z) is a free Z-module of rank 6, we obtain that H*{D,Z)/H*(¥ 5 ,Z) is 
a free Z-module of rank 18, and so H*(F 1 , Z) is of rank 36. 

Similarly, F 2 is a fibration in P 3 over G w (4, 7) so H*(F 2 ,Z) is a free module of 
rank 4 over H*(G U (&, 7),Z). The latter is a free Z-module of rank #I£ 7 = 8 so 
H*(F 2 ,Z) is of rank 32, and so F 1 and F 2 are not isomorphic. ■ 

This concludes the proof of the proposition l5.13l 

5.18. We can tackle now the final step in our calculation of the automorphism 
group of G ul (k,E). Recall that what we are left to prove now is that any element 
of Aut(PA< fc >£;,G w (fc,£;)) comes from PSp 2n+1 . 

An element g <E Aut(F A^ E,G UJ (k,E)) induces an automorphism of the Fano 
scheme F of 15.121 By 15.131 F is either irreducible and isomorphic to F 1 , or it has 
a second irreducible component F 2 which is not isomorphic to F 1 . Therefore g 
induces an automorphism of F 1 , which is to say that g sends p 2 (™- fc )+ 2, s f the 
first kind to p2(»-fc)+2> s f tne first kind. 

Let p : F 1 — ► G w (fc — 1, E) be the projection. 

Proposition 5.19. The automorphism induced by g on F 1 permutes the fibers of 
p and induces an automorphism g ofG UJ (k — 1,E). 
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Proof. We abuse notation and denote the automorphism induced by g on F 1 by the 
same letter g. The projection p is an isomorphism over the open Sp 2 „_ ) _ 1 -orbit X\ 
oiG u (k — l,E) (cf. the proof of lemma l5.1tj|) and the points of p~ 1 (Xi) correspond 
to the p 2 ("-- fc )+ 2 ' s f the first kind which are maximal as linear spaces contained in 
G u (k, E). As g sends a maximal p 2 (™- fe )+ 2 of the first kind on a maximal p 2 ("-- fc )+ 2 
of the first kind, it follows that g sends the open set p~ 1 (Xi) on itself. 

Let now (V*~ l ,H x ), (\f^ 1 ,H 2 ) be two points of p~ 1 (X ) C F 1 and L x , L 2 the 
corresponding p 2 (™- fe )+ 2, Sj that is, 

In = {V G G(k,E) | V* -1 cVcfli} 
L 2 = {V G G(fc, B) | tff" 1 G V G H 2 }. 

If V^ 1 = V^ 1 = V fc -\ then H 1 DH 2 is of codimension 2 in (V^ 1 ) 1 - and Li and 
L 2 cut along a p2(«-*0+i. 

L 1 nL 2 = {v e G(k, E) | v k - x g V c Fi n H 2 } ~ p»(»-*)+i. 

If V^" 1 ^ V^ -1 then the intersection 

Li n L 2 = {^ G G(fc, J5) | vf' 1 + v 2 k - 1 G V G #1 n iJ 2 } 

is either empty or it reduces to a point: if V G L\ n L 2 then necessarily V = 
Vjk -1 + V^ -1 since y^ -1 and V^ -1 are distinct hyperplanes in V. It follows that 
g sends a fiber of p on a fiber of p, and so it induces a bijection g such that the 
following square commutes: 

F 1 »- F 

(15) 

G u (k-l,E)—±+G u (k-l,E). 

Since F 1 is projective, the projection p is a closed map and so g is continuous for 
the Zariski topology. On the other hand, g is regular on the open orbit X\ since 
p is an isomorphism over X\. The closed orbit Xo is of codimension at least 2, 
and since G UJ (k — 1,E) is normal this implies that g is regular everywhere. Indeed, 
for any affine open set U C G u (k — 1, E) the preimage g _1 (C/) is normal and the 
restriction g\g-im) lii given by some rational functions, which are regular outside 
a codimension 2 closed set and therefore extend to the whole of g _1 (C/). It follows 
that g\xi extends to a regular map on G ul (k — 1, E) which, by continuity, has to be 
~9- ■ 

We have just shown that an automorphism of G UJ (k, E) induces an automorphism 
of G u (k — 1,E). Iterating, it follows that an automorphism of G UJ (k,E) induces 
an automorphism of G w (l,-E) = FE, that is, an clement h G PSL(E). We now 
only need to show that h is in PSp 2n+1 and that the automorphism of G u] {k, E) it 
defines coincides with our initial automorphism. This is done in the following two 
lemmas. 

Lemma 5.20. // the automorphism of G(2, E) induced by some h G PSL(_B) pre- 
serves G U {2,E) then h G PSp 2ra+1 . 

Proof. Let ft, be a representative of h in SL(E). Then h preserves orthogonality, 
that is, for all u,v G E 

uLv => hu-Lhv, 

since an isotropic subspace of dimension 2 is generated by two orthogonal vectors 
and conversely. In other words, the automorphism {u, v) i— ► (hu, hv) preserves the 
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affine closed set 

{(u,v) e E x E\ w(u,v) = 0}. 
Since u> is irreducible as a degree two polynomial on E x E, it follows that there 
is A G C* such that ui(hu,hv) = Xuj(u,v) for all u,v G E, ie that hu> = A _1 oj. So, 
if /i G C* is a square root of A" 1 , then (fih)uj — lu, that is, \ih € Sp 2n+1 and so 

ftePSp 2n+1 . ■ 

Lemma 5.21. Let g be an automorphism of G UJ {k 1 E) and g the automorphism 
it induces on G u (k — 1,25). If g is induced by some h G PSp 2n+1 then g is also 
induced by h. 

Proof. Through any point V G G UJ (k,E) passes a p 2 ( ra - fc )+ 2 f the first kind. In- 
deed, it suffices to choose V k ~ 1 c V of dimension k— 1 and H of dimension 2n—k+2 
such that V G H G (V *) , and to consider the linear space L they define by 
p.'jfl. Then gL passes through gy and the commuting square (|15|l shows then that 
for all V G G u (k, E) and V k ^ G G(jfc - 1,25) we have 

V*- 1 cV=> gV k ~ l = ^(F^ 1 ) G ffV. 

Since the hyperplane V k ~ 1 C V^ is arbitrary, it follows that gV — h(V). ■ 

6. A Borel-Weil theorem for the odd SYMPLECTIC group 

We set out to prove the Borel-Weil type theorem stated in the introduction. We 
start by examining the preferred classes of modules which appear as the spaces of 
global sections of line bundles on the odd symplectic flag manifold ¥ u (2n + 1). 

6.1. Shtepin's class of sp 2n+1 -modules. In Sht93 , Shtepin deals with the 
problem of separating multiple components when restricting simple sp 2n +2" mo dules 
to sp 2 „. There is no semi-simple Lie algebra sitting between sp 2n+2 and sp 2n which 
could be used as an intermediate step in the reduction sp 2n+2 J. sp 2rl - Instead, 
Shtepin considers the non-reductive intermediate Lie algebra sp 2n+1 and constructs 
in each simple sp 2n+2 -module V a filtration by sp 2n+1 -modules 

Vi C • • • C V p C V 

such that the factors Vi+i/Vi are pairwise non-isomorphic and multiplicity free 
sp 2 „-modules. It turns out that the sp 2n+1 -modules Vi+i/Vt have nice properties, 
in particular as we will show below, they appear as spaces of global sections of line 
bundles on ¥ UJ (2n +1). We now give a short account of this construction. 
We will use Shtepin's definition for the intermediate Lie algebra, which is 

(16) sp 2n+1 = {l£ sp 2n+2 | Xe n = 0}. 

This is not just a mere change of notation with respect to our definition from l3.lTl 
since we still want to distinguish the Borel subalgebra b 2 „+ 2 of sp 2n+2 of upper 
triangular matrices in the symplectic basis {eo, . . . , e 2n +i} as giving the positive 
roots and thus the notion of dominant and highest weights. Of course, we can 
get back to our definition from 13. ill bv conjugating by some element g G Sp 2n+2 
which sends e„ to eo, but then we will also have to conjugate the Borel subalgebra 
and consider as positive roots the roots of <?b 2n + 2 (7 _1 , which is rather awkward. In 
accordance with the definition l(TB|l we now embed sp 2n G sp 2n+2 as the subalgebra 

sp 2 „ = {X G sp 2n+2 | Xe n = 0, Xe n = 0}. 

Let t 2n + 2 be the Cartan subalgebra of sp 2n+2 of diagonal matrices in the sym- 
plectic basis {eo, . . . , e 2 „+i} and fa 2 ~„ +2 the Borel subalgebra opposite to b 2 „+ 2 . 
Denote U2~ n+2 , u 2n+2 the maximal nilpotent subalgebras of ^n+i an( i ^2n+2- Let 
tan = t 2n +2 nsp 2n , b 2n = b 2n+2 nsp 2 „, respectively uf n = uf n+2 n sp 2n be the 
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corresponding subalgebras of sp 2n . Denote also u 2n+1 = u 2n+2 (~l sp 2n+1 and 
&2n+i = &2n+2 nsp 2n+1 . Then b 2n+ i = t 2 „ ©l^i + i, but note that b 2 „+i is not a 
Borel subalgebra of sp 2n+1 . We have the decomposition 

(17) sp 2 n+i = "iTn+i © t 2n © u£ n+1 . 
Note that since we have 

U 2n+1 = U 2n © \JJ CXifj © CX nS 
0^i<n-l 

U 2n+1 = U 2n © VP CX„j, 

the t 2n -weights of u 2n+1 are the positive roots of sp 2 „ to which we add the £», for 
1 sj i sj n — 1 (and corresponding to the element X nn ) and the t 2 „-weights of 
u 2n+i are their negatives (except for the weight which does not appear). Having 
this analogy between the decomposition (|17[) and a Cartan decomposition is the 
reason to choosing the definition (|16|l instead of our earlier one. 

Let V be a simple sp 2n+2 -module. Shtepin constructs his filtration in V using an 
explicit model of V as a space of fu nctions on the unipotent group U 2n+2 with Lie 
algebra u 2n+2 due to Zelobenko (cf. |Zel62J ). which we won't detail here. Following 
Shtepin, we call semi-maximal the i 2 „+ 2 -eigenvectors of V which are killed by u 2n . 
These are exactly the highest weight vectors of the simple pieces of a decomposition 
of V as a sp 2 „-module. Among the semi-maximal vectors we choose those which are 
killed by the elements Xo n , X\ n , . . . , A„_i „ of u 2n+2 , which we call quasi-maximal. 
We order them vi, . . . ,v p in a natural way coming from their explicit expressions 
in the Zelobenko model and we define then the filtration V\ C • • • C V p in V by 
taking Vi to be the sp 2n+1 -module generated by vi, ■ ■ . ,Wj. 

The ordering vi, . . . , v p is chosen such that for all 1 ^ i ^ p — 1 we have 
u 2n+i u i+i S Vi, so the image Uj+i of Vi+i in Vi+i/Vi is a vector killed by U2^ +1 , 
ie a maximal vector with respect to sp 2 „ +1 . The factor Vi+i/Vi is a cyclic sp 2n+1 - 
module generated by the maximal vector Sj+i, and so, if fi is the t 2 „-weight of Uj+i, 
Vi+i/Vi is a quotient of the Verma-like module 

(18) U(fp 2n+1 ) ®ff(b 3B+1 ) C M 

where C M is the b 2n +i-module of dimension 1 on which b 2 „+i acts through the 
weight \i. This already accounts for some properties of the sp 2n+1 -module Vi+i/Vi 
similar to properties of simple modules for semi-simple Lie algebras, such as: 

(1) n is the highest weight of Vi+i/V,, ie the weights of Vi+i/Vi are of the form 
fi — 6 with 9 in the semi-group generated by the positive roots of sp 2n+1 ; 

(2) the Weyl group W(Sp 2n ) ac ^ s on the weights of Vi+i/Vi and for any w £ 
W(Sp 2n ) the w/z-eigenspace is of dimension 1; 

(3) any sp 2n+1 -module endomorphism of Vi+i/Vi is scalar, in particular Vi+i/Vi 
is indecomposable; 

(4) Vi+i/Vi has a lowest weight, which is wofj, where wq is the longest element 
oiW(Sp 2n ); 

etc. 

Actually, if A is the highest weight of the simple sp 2n+2 -module V, then the quasi- 
maximal vectors of V (and so the factors Vi+i/Vi) are parametrized by patterns 
fi — ► A, where /i is also an sp 2n+2 -dominant weight and where the notation fj, — * A 
means 



Al ^ H\ ^ A2 ^ • • • ^ (J*n ^ A„+l ^ f-ln+1- 



ODD SYMPLECTIC FLAG MANIFOLDS 29 

The quasimaximal vector q^x corresponding to the pattern \i — > A is a t 2n + 2 - 
eigenvector with weight 

H- (|A| - \n\)s n , 
in particular its t 2 n-weight is /z|t 2 „. Let us denote by V\ the simple sp 2n+2 -module 
with highest weight A. Shtepin proves then the following result: 

Theorem 6.2. The factor of the filtration of V\ generated by the image of the 
quasimaximal vector q^x is isomorphic to the Sp 2 „ +1 -sufemo<iuZe ofV^ generated by 
the highest weight vector. 

Denote by V^ this sp 2n+1 -module. Note that VI does not depend only on /z|t 2 „, 
as one might suspect given that it is a quotient of the Verma module (|T%|l . In 
fact it is already so for its structure as an sp 2 „-module, as Shtepin shows that the 
decomposition of V' into irreducible sp 2n -modules is 



(19) V'J 



where V" is the simple sp 2 „-module of highest weight v and where the notation 
v — * fj, now means 

Hi ^ V X > jU 2 > • • • > A*n > V n ^ /i„+i. 

We will also need to consider the parabolic subalgebra 
p = {X G sp 2n+2 | X(Ce n ) C Ce„}. 
We have 

P = Sp2n+1 © CX„„ 

and since X nn G t 2n +2, the modules Vi of the filtration of a simple sp 2n+2 -module V 
are also p-modules. Similarly, the sp 2n+1 -submodule V^ of a simple sp 2n+2 -module 
V/j, generated by the highest weight vector is a p-module. Then from the theorem 
16. 21 it follows that the factor of the filtration of a simple sp 2n+2 -module V\ generated 
by the image of the quasimaximal vector q^x is isomorphic to the p-module 

y£®c_ ( | A |_ H)e „. 

6.3. The sp 2n+1 -modules of Proctor. We continue to use the definition (|16() and 
accordingly, by sp 2n+1 we mean the Lie algebra of the odd symplectic group Sp 2n+1 
associated to the odd symplectic form w\ e ±. Recall from 13.61 that the restriction 
morphism g n> g\x induces a surjective morphism p — > sp 2rl+1 which restricts to a 
surjective morphism sp 2 „ +1 — ► sp 2rl+1 fiskn+i- The kernel of both these morphisms 
is the one dimensional space CX nf i. 

In |Pro88j , Proctor uses an adapted form of the construction of Weyl to define 
a special class of sp 2n+1 -modules. Let us recall this construction. 

Let u> G A 2 V* be a generic skew-form on a complex vector space V, and let A 
be a partition. The GL(V)-module of highest weight A coincides with the Schur 
power S\V C V® d , where d — |A|. For 1 ^ p < q ^ d, denote (p pq the contraction 
by w on the indices p et q 

Vpq : V® d — » V®^ 2 

V\ ® ■ • ■ <8 V n I ► Ld(Vp,V q )vi ® ' ■ ' Cg> Vp <8> • ■ • <8> V q <S> • • • ® V n . 

Following JFH91I §17.3], denote 

V {d) =f)Ke* ip pq cV® d 

p. < i 

the space of "trace free" d-tensors, and finally 

s {x) v = SxVnv^. 
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When V = C 2r \ if l{\) > n then S { x)C 2n = 0, and if l{\) < n then S' <A) C 2n is the 
simple sp 2 „-module of highest weight A. 

In |Pro88| . Proctor studies the sp 2rl+1 -modules S(\)C 2n+1 . He shows for example 
the following (cf. |Pro88l theorem 2.1]) : 

Proposition 6.4. If £(X) > n + 1 then S' (A) C 2 ™ +1 = 0. If i{\) < n + 1 then the 
sp 2n+ i-module S {\)<C 2n+1 is indecomposable. 

He further describes weight bases for the modules S(x)<C 2n+1 and gives a formula 
for the i 2n -character of S'(a)C 2 ™ +1 similar to Weyl's formula. As it turns out (cf. 
|Pro88l corollary 8.1]), the decomposition of S(\)C 2n+1 in simple sp 2n -components 
is also given by the formula (|19fl . This is not a mere coincidence, since we have: 

Proposition 6.5. As a p-module via the morphism p — ► sp 2n+1; S^C 2 ™ -1-1 is 
isomorphic to the p-module V^. 

Proof. Let E = C 2n+2 and Q G A 2 E* be the symplectic form on E for which the 
basis {eo, . . . , e2n+i} is symplectic. Denote E — e„ and u = u\e- We identify 
the simple sp 2n+2 -module V\ of highest weight A with S(x)E. The highest weight 
vector v\ G V\ coincides in this case with the image in S\E of the tensor 

e A = e ® Ao <g> ef Al g> • • • ® e® A " e ^ <8>|A| . 

But since e A € E® w , we have v x G S X E C S X E. On the other hand, v x G E {W) 
since clearly the contractions (|20|l defined by ui are just the restrictions to E®\ x \ of 
the contractions (|2~U|l defined by u. Therefore v x £ S(\)E. 

Since p acts on S( X )E through the restriction morphism p — ► sp 2n+1 , it follows 
that the p-module V^ generated by v x is actually contained in S{\)E. But V x 
and S{\)E have the same dimension, since they are isomorphic as sp 2 „-modules. 
Therefore they must coincide. I 

6.6. Borel-Weil for the odd symplectic group. Let G be a semi-simple com- 
plex Lie group, BcGa Borel subgroup and T C B a maximal torus. Denote W 
the associated Weyl group. Let e 1 be the fixed point in the flag variety G/B of the 
opposite Borel subgroup B~ . Denote then, for w G W, e w — w(e 1 ) and X w the 
opposite Schubert variety which is the closure of the i?~-orbit of e w . For a weight 
A let L x be the line bundle on G/B whose fiber at the point e 1 is the i? _ -module 
Ca- By the Borel-Weil theorem, if A is dominant then H°(G/B,L X ) ~ V x , where 
V\ is the simple G-module of highest weight A. Denote the restriction of L x to 
the Schubert variety X w also by L x . Then (cf. |.Tan03l §14.19]) the restriction 
morphism 

H a (G/B,L x )^H°(X w ,L x ) 
is surjective and 

(21) H°(X w ,L x y ~ Span(£r . V - wX ) C Vf 

where v_ w x G V x * is a vector of weight — wX (unique up to a scalar factor) and 
Span(B~ • V- W x) is the B~-submodule it generates. 

Denote also e\ the fixed point in G/B of B, and, for w G W, X w the Schubert 
variety which is the closure of the i3-orbit of e w = w(e\). Then X w — wqX w , where 
Wq is the longest element of W. Conjugating by wq in l|21(l we get 

(22) H°(X w ,Lx)* ~ Span(B ■ v_ WoW x) C V£. 

Take now G = Sp 2n+2 , B 2n +2 C Sp 2n+2 the Borel subgroup of upper triangular 
matrices in the symplectic basis {eo, . . . , e 2n+ i}, T 2n+2 C B 2n +2 the maximal torus 
of diagonal matrices in the basis {eo, . . . ,e 2n+ i}, and denote E = e$ . Let w — 
12 . . . nO G W(Sp 2n+2 ) so that, as in 14371 F U (E) = X u ... s0 . Note that the longest 
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element wo of the Weyl group W(Sp 2n+2 ) acts as —1 and V£ ~ V\. From $F2£ we 
get 

(23) H°(¥ U (E), L x y * Span(S 2n+2 • v wX ) c V x . 

Since ¥ U (E) is P-stable, where P is the parabolic subgroup preserving the line 
Ceo, we have Span(P 2n+2 • V w \) = Span(P • v w \) and this isomorphism is also an 
isomorphism of P-modules. 

Denote also E' = e^ and consider ¥ U1 (E') which embeds in ¥ LJ (2n + 2) as 

{(Vi C ■ ■ • C K+i) G F w (2n + 2) | V n+1 C £'}. 

Let P' be the parabolic subgroup preserving the line Ce n and p' its Lie algebra 
(which in Iti. II has been denoted p). 

Proposition 6.7. As a p' -module, H°(¥ UJ (E'),L\)* is isomorphic to Shtepin's V£. 

Proof. Since w(n) — 0, we have ¥ UJ (E') = w~ 1 ¥ lll (E) and P' = w~ 1 Pw, so conju- 
gating by w in (21, we get H°{¥ UJ (E , ),L X )* ~ Span(P' • v A ) = Vj(. ■ 

Corollary 6.8. As p' -modules, H°(¥ U (E'), L A )* ~ 5 (A) P'. 

Proof. This follows immediately from lfi.lTl ■ 

Let now T^ be the tautological bundle of rank i on the symplectic flag manifold 
¥ LJ (2n + 2), whose hber at a point (Vi C • •• C V^+i) is Vi. The restriction P^f^e) 
is then the rank i tautological bundle on ¥ U1 (E) and we denote it also by T,-. We 
have Tj+i/Tj = L_ £i for 1 ^J i ^J n and Ti = L_ Eo so 

La = Pr® Ao ® (T 2 /T!)^ Al ® ■ • ■ ® (T„ +1 /T„)*® A ". 

Theorem 6.9. Lei A = (Ao ^ • • ■ ^ A n Js 0) fee a partition and L\ the line bundle 
on¥ u (E) 

L x = T*® A ° ® (T 2 /Ti)*® Al (g) ■ • ■ ® (T„ +1 /T„)*® A ". 
Then as Sj> 2n+1 -modules, H°(F UJ (E),L\)* ~ S(\)E. 

Proof. First denote Sp 2n+1 the odd symplectic group which is the image of P' via 
the restriction morphism g \— > grl^/. Then the modules in 16.81 are also Sp 2n+1 - 
modules. We have Sp 2n+1 = wSp' 2n+1 w~ 1 and the result follows from 16.81 once we 
observe that S^x)E — wS^x)E' as subspaces of S'(a)C 2 " +2 . ■ 

Note that the statement of thcorcm l6.9l is independent of the embedding ¥ U (E) C 

F w (2n + 2). 

References 

[Akh95] D.N. Akhiezer, Lie group actions in complex analysis, Aspects of Mathematics, E27, 

Friedr. Vieweg & Sohn, Braunschweig, 1995. 
[Bou68] N. Bourbaki, Elements de mathematique. Fasc. XXXIV. Groupes et algebres de Lie. 

Chapitre IV: Groupes de Coxeter et systemes de Tits. Chapitre V: Groupes engendres par 

des reflexions. Chapitre VI: systemes de racines, Actualitcs Scicntifiques et Industriclles, 

No. 1337, Hermann, Paris, 1968. 
[FH91] W. Fulton and J. Harris, Representation theory, Graduate Texts in Mathematics, vol. 

129, Springer- Ver lag, New York, 1991, A first course, Readings in Mathematics. 
[GH78] Ph. Griffiths and J. Harris, Principles of algebraic geometry, Wiley-Interscience [John 

Wiley & Sons], New York, 1978, Pure and Applied Mathematics. 
[GZ84] I.M. Gel'fand and A.V. Zelevinskii, Models of representations of classical groups and 

their hidden symmetries, Funktsional. Anal, i Prilozhen. 18 (1984), no. 3, 14—31. 
[Har77] R. Hartshorne, Algebraic geometry, Springer- Verlag, New York, 1977, Graduate Texts in 

Mathematics, No. 52. 
[Har95] J. Harris, Algebraic geometry, Graduate Texts in Mathematics, vol. 133, Springer- Verlag, 

New York, 1995, A first course, Corrected reprint of the 1992 original. 



32 ION ALEXANDRU MIHAI 

[Jan03] J.C. Jantzen, Representations of algebraic groups, second ed., Mathematical Surveys and 
Monographs, vol. 107, American Mathematical Society, Providence, RI, 2003. 

[LM06] J.M. Landsberg and L. Manivel, The sextonions and E ? i , Adv. Math. 201 (2006), no. 1, 
143-179. 

[Mac95] I.G. Macdonald, Symmetric functions and Hall polynomials, second ed., Oxford Math- 
ematical Monographs, The Clarendon Press Oxford University Press, New York, 1995, 
With contributions by A. Zelevinsky, Oxford Science Publications. 

[Mih] LA. Mihai, Equivariant cohomology of the odd symplectic flag manifold, in preparation. 

[Mih05] , Varietes de drapeaux symplectiques impaires, Ph.D. thesis, Institut Fourier, 

2005. 

[Pro82] R.A. Proctor, Classical Bruhat orders and lexicographic shellability, J. Algebra 77 (1982), 
no. 1, 104-126. 

[Pro88] , Odd symplectic groups, Invent. Math. 92 (1988), no. 2, 307-332. 

[Sht93] V.V. Shtepin, Intermediate Lie algebras and their finite-dimensional representations, 
Izv. Ross. Akad. Nauk Scr. Mat. 57 (1993), no. 6, 176-198. 

[Zcl62] D.P. Zclobcnko, Classical groups. Spectral analysis of finite- dimensional representations, 
Uspehi Mat. Nauk 17 (1962), no. 1 (103), 27-120. 



